Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Build evaluation infrastructure for Aircall’s AI voice, chat, and messaging agents. Responsibilities include designing benchmarks and metrics, training and fine-tuning TTS, ASR, and speech-to-speech models, developing automated regression and release gates, calibrating LLM-as-judge systems, analyzing failures, monitoring production quality and drift, and evaluating voice-specific scenarios such as accents, noise, barge-in, DTMF, latency, and tool failures.

Own technical strategy and long-term AI adoption for strategic enterprise accounts. Lead discovery, solution design, integrations, AI Agent configuration, and complex cross-functional deployments using APIs, scripting, low-code tools, and CRM automation. Partner with account managers to drive expansion pipeline, advise senior stakeholders, develop reusable frameworks, mentor engineers, and influence product roadmaps through customer insights.

Leads and scales the Forward Deployed Engineering team while overseeing customer-facing AI Agent deployments, technical integrations, go-to-market execution, operating KPIs, reusable playbooks, and cross-functional alignment. Partners with Sales, Product, Engineering, Marketing, Support, and Account Management to improve deployment quality, adoption, revenue impact, and product evolution. Requires strong technical fluency with APIs, integrations, modern architectures, and coding, alongside experience in technical sales, solutions engineering, forward-deployed engineering, or professional services.