Decagon Logo

Decagon

Research Engineer, Safety

Posted 8 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
200K-400K Annually
Junior
In-Office
San Francisco, CA, USA
200K-400K Annually
Junior
Research Engineer focused on AI safety for conversational agents. Responsibilities include developing safeguards against prompt injection, unsafe tool use, data disclosure, policy violations, and hallucinations; building adversarial evaluations, red-team datasets, classifiers, judges, reward signals, and runtime protections; analyzing production incidents; and partnering across teams to deploy scalable, reliable safeguards.
The summary above was generated by AI

About Decagon

Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences.

Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel.

We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others.

We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values — Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle — shape how we work and grow as a team.

About the Team

Read more about the research team's work here: https://decagon.ai/blog/introducing-decagon-labs
The Research team develops the model and decision-making stack that powers Decagon’s conversational agents for enterprise support. We research, adapt, and implement state-of-the-art techniques in model training, prompting, orchestration, and evaluation in order to make our agents more accurate, robust, and efficient in real-world deployments.

Our goal is to push the frontier of applied conversational AI: agents that reliably understand nuanced intent, track long context, and take the right actions under uncertainty. We measure success the way customers feel it: higher resolution rates, better user satisfaction, and consistent behavior at scale.

 

About the Role

As a Research Engineer focused on Safety, you’ll be responsible for making Decagon’s AI agents safe, reliable, and controllable, from evaluation through production. You’ll identify real-world failure modes and build the models, evaluations, and safeguards that prevent them.

We’re looking for strong engineers who want to advance applied AI safety in production. People here own their work end-to-end, ship real improvements, and are trusted to make high-impact technical decisions.

 

In this role, you will

  • Research and build safeguards against prompt injection, unsafe tool use, sensitive-data disclosure, policy violations, and hallucinated commitments

  • Build adversarial evaluations, simulations, red-team datasets, and regression suites informed by production failures

  • Develop and deploy classifiers, judges, reward signals, post-training methods, and runtime safeguards for safer agent behavior

  • Analyze production traces and incidents to identify root causes, test mitigations, and measure their impact

  • Partner with Security, Product, Infrastructure, Legal, and customer-facing teams to turn enterprise requirements into scalable safeguards and rollout practices

 

Your background looks something like this

  • 2+ years of experience in AI/ML engineering, research, or AI safety

  • Hands-on experience evaluating, post-training, or deploying language models or agentic systems

  • Experience with modern post-training techniques, such as reinforcement learning, preference optimization, distillation, model routing, and synthetic-data generation

  • Experience with adversarial testing, model red teaming, prompt injection, policy enforcement, privacy, or safe tool use

  • Fluency in Python and modern ML tooling, with strong experimental judgment and the engineering depth to ship production systems

  • Comfort owning ambiguous, high-stakes technical problems and making clear risk and product tradeoffs


Even better if you have

  • Experience building safeguards for high-stakes or regulated enterprise workflows

  • Familiarity with human-in-the-loop review, incident response, or responsible rollout frameworks for ML systems

 

Compensation

$200K – $400K + Offers Equity

This range reflects the expected compensation for this role. Compensation within the range is determined based on experience, skills, and the scope of responsibilities, with flexibility for candidates who demonstrate exceptional impact.

In addition to base salary, we offer competitive equity. Final compensation may vary based on location within the United States.

Benefits

We proudly offer the following benefits for our full-time employees:

  • Medical, Dental, and Vision benefits for you and your family

  • Life Insurance and Disability Benefits

  • Retirement Plan (e.g., 401K, pension)

  • Parental Leave

  • Fertility and family building benefits through Carrot

  • Monthly stipend to support your wellness, lifestyle, and work-life balance

  • Daily lunches and snacks in the office to keep you at your best

  • Take what you need vacation policy (subject to local requirements; UK employees receive 25 days of statutory leave)

These benefits are described in more detail in Decagon’s policies, may vary by location, and can change at any time according to applicable compensation and benefits plans.

Similar Jobs

8 Days Ago
In-Office
San Francisco, CA, USA
200K-400K Annually
Senior level
200K-400K Annually
Senior level
Artificial Intelligence • Software
Research Engineer responsible for improving the safety, reliability, and controllability of conversational AI agents. The role develops safeguards, adversarial evaluations, red-team datasets, classifiers, judges, reward signals, post-training methods, and runtime protections. Responsibilities include analyzing production incidents, identifying failure modes, measuring mitigations, and partnering with security, product, infrastructure, legal, and customer-facing teams to deploy scalable safety practices.
Top Skills: Adversarial TestingConversational AiLanguage ModelsModel DistillationModel RoutingPreference OptimizationPrivacy SafeguardsPrompt Injection DefensesPythonReinforcement LearningRuntime SafeguardsSynthetic Data Generation
3 Days Ago
In-Office or Remote
5 Locations
224K-431K Annually
Expert/Leader
224K-431K Annually
Expert/Leader
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Develop and formalize methods to validate reported vulnerabilities and generate/verify safe patches for internal NVIDIA targets. Define correctness, regression, and revalidation standards; produce repeatable, auditable processes and evidence. Apply AI-assisted workflows cautiously, perform bounded applied research on vulnerability classes, and document findings for independent security review.
Top Skills: Ai-Assisted ToolsCC++FuzzingLlm-Based AgentsProgram AnalysisPythonStatic AnalysisSymbolic Execution
2 Months Ago
In-Office
230K-535K Annually
Senior level
230K-535K Annually
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Generative AI
Build and own tooling and data pipelines for synthesis, annotation, validation, and analysis of real and synthetic data to support model training and evaluation. Collaborate with researchers and engineers to align data infrastructure with experiments, maintain documented standards, and develop frameworks to identify coverage gaps and improve data quality.
Top Skills: JaxPythonPyTorchTensorFlow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account