Sesame (sesame.com) Logo

Sesame (sesame.com)

Research Engineer

Reposted 16 Days Ago
In-Office
San Francisco, CA, USA
190K-320K Annually
Expert/Leader
In-Office
San Francisco, CA, USA
190K-320K Annually
Expert/Leader
The ML Engineer will design, build, and automate evaluation pipelines, curate datasets, train and deploy voice models, monitor performance, and manage production code across various stages of the machine learning lifecycle. They will also collaborate closely with research and infrastructure teams to enhance user-facing systems.
The summary above was generated by AI

About Sesame

Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice agents part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive.


Responsibilities:
  • Own evaluation pipelines — design, build, and automate offline and live evals that keep our speech and multimodal models honest in production.

  • Harness the data — create tooling for safe, versioned, privacy-aware dataset curation and discovery.

  • Ship models, not slide decks — partner with research and infra to prototype, train, and deploy state-of-the-art voice models that power Sesame’s real-time companion experience.

  • Squeeze silicon — scale training and inference for LLM-class workloads; chase latency, throughput, and cost until the graphs flatten.

  • Wire up monitoring and live evals — surface quality regressions before users or PMs notice.

  • Move at startup speed — take ideas from whiteboard to production in days, not quarters; leave a clean trail of tests and dashboards behind.

Required Qualifications:
  • Expert-level PyTorch.

  • Proven software engineer who loves ML; comfortable writing production code across the stack.

  • Hands-on experience training or fine-tuning large language or other large-scale models with a variety of techniques.

  • Evaluation expert — you’ve designed metrics and harnesses that actually predict user happiness.

  • Deep knowledge of the ML lifecycle: dataset ops, training pipelines, eval frameworks, deployment, and monitoring.

  • History of shipping complex projects to production—especially user-facing, online ML systems—despite shifting requirements and surprise roadblocks.

  • High agency and the judgment to know when to sprint solo vs. pull in the squad.

  • Track record of setting technical direction, driving consensus, and partnering smoothly with product, infra, and research.

Sesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilities. Contact [email protected] for assistance.

Full-time Employee Benefits: 

  • 401 (k) max employer match: 3.5% of compensation

  • 100% employer-paid health, vision, and dental benefits for you and your dependents

  • Unlimited PTO and sick time

  • Flexible spending account with employer matching up to $1,650/year (medical FSA)

  • Guardian Employee Assistance Program (EAP)

  • Opportunity to share in the company's success with competitive stock options

Benefits do not apply to contingent/contract workers.

Similar Jobs

14 Days Ago
In-Office
Sunnyvale, CA, USA
207K-275K Annually
Senior level
207K-275K Annually
Senior level
Cloud • Information Technology • Machine Learning
Lead applied research to advance continuous learning for agents: design and evaluate LLM post‑training and RL methods, implement and deploy experiments at scale, validate research on customer tasks, optimize GPU/distributed training, and mentor engineers while driving cross‑functional technical direction.
Top Skills: CudaFastapiGpuKubernetesMegatronPostgresTemporal
14 Days Ago
In-Office
Sunnyvale, CA, USA
182K-242K Annually
Senior level
182K-242K Annually
Senior level
Cloud • Information Technology • Machine Learning
Drive applied research to enable continuous learning for agents: design and evaluate LLM post-training methods (fine-tuning, RL, distillation), run large-scale GPU experiments, validate approaches on customer tasks, and help deploy and scale models and infrastructure across the stack.
Top Skills: CudaDistributed TrainingFastapiGpusJaxKubernetesLlmsMegatronPostgresPythonPyTorchReinforcement LearningTemporal
6 Days Ago
In-Office or Remote
San Francisco, CA, USA
500K-850K Annually
Mid level
500K-850K Annually
Mid level
Artificial Intelligence • Natural Language Processing • Generative AI
Develop and evaluate agent harnesses and infrastructure for LLM-driven agents; design large-scale quantitative benchmarks and automated evaluation pipelines; collaborate with product and research teams to apply agents in products; and create/optimize data mixes and finetuning strategies to improve agent performance.
Top Skills: Agent HarnessesClaudeLlmsModel EvaluationModel Fine-TuningModel OrchestrationMulti-Agent SystemsPromptingReinforcement LearningSynthetic Data Generation

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account