Cognition Logo

Cognition

Research Engineer, Safety & Alignment

Posted 5 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Entry level
In-Office
San Francisco, CA, USA
Entry level
Conduct AI safety and alignment research for autonomous software agents. Build release-gating evaluations, red-team models and agent harnesses, develop alignment methods, and improve permissions, oversight, escalation, and model behavior. The role combines empirical research engineering with production agent development, requiring collaboration across safety, post-training, and agent teams, plus contributions to external safety research.
The summary above was generated by AI
We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

Role Mission

Devin writes and runs code, uses tools, takes actions in real customer systems, and operates for hours without a human in the loop. Safety here is not a research paper; it is whether an agent behaves correctly in production, millions of times a day. You will be a founding member of Cognition's safety team, reporting to the Head of Safety. You will build the evaluations and red-teaming that gate every release, develop alignment methods that shape how our models are trained, and work directly with the agent team on how Devin plans, acts, and asks for help. This is a hands-on research engineering role for someone who wants their safety work to run in the loop of a real agent, not sit in a benchmark.

What You'll Accomplish
  • Build agentic safety evals: Design and run evaluations for the failure modes that matter for autonomous agents: unsafe actions, prompt injection, data exfiltration, sandbox escape, reward hacking, and misuse. Make them fast enough to run on every model and product release.

  • Red-team Devin: Attack the agent and its harness systematically. Find the failures before customers do and turn them into fixes and regression tests.

  • Develop alignment methods: Work with post-training on reward modeling, preference data, constitutional approaches, and other techniques that make the model safer without making it worse at the job.

  • Shape the agent harness: Partner with the agent team on permissions, oversight, and escalation: when Devin should act, when it should ask, and how it should explain itself.

  • Publish and share: Contribute to Cognition's external safety work through papers, evals, and open methods where it makes sense.

Exceptional Candidates Have Demonstrated
  • Safety or alignment research experience: Hands-on work on evaluations, red-teaming, alignment, or interpretability at a frontier AI lab or in published research. You have built things that changed how a model was trained or deployed.

  • Agentic systems understanding: You know how agents fail in practice: tool misuse, specification gaming, long-horizon drift, adversarial inputs. You have measured it or have concrete ideas about how to.

  • Strong engineering fundamentals: Proficiency in Python and PyTorch (or JAX). You can build eval infrastructure, run experiments at scale, and read the training and inference code.

  • Empirical rigor: You design clean experiments, report results honestly, and know the difference between a real improvement and noise.

  • Comfort with adversarial thinking: You enjoy breaking systems and are good at it.

  • Relevant industry experience: Prior experience at a frontier AI lab, applied AI company, or developer tools company.

  • Advanced degree: PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline; or equivalent industry research experience.

Our Commitment

Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.

Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement.

HQ

Cognition San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

10 Days Ago
In-Office
San Francisco, CA, USA
Entry level
Entry level
Artificial Intelligence • Machine Learning • Generative AI
Lead Search Integrity research by defining technical direction, developing AI and ML systems to detect spam, scams, phishing, malicious domains, prompt injections, and other adversarial web content. Identify signals across pages, links, metadata, and site relationships; build evaluations; translate integrity signals into indexing, ranking, and filtering decisions; and partner with research, engineering, safety, and integrity teams to deploy production systems.
Top Skills: Adversarial Content DetectionArtificial IntelligenceClassifiersFrontier ModelsInformation RetrievalMachine LearningSearch IndexingWeb Spam Detection
2 Months Ago
In-Office
Redwood City, CA, USA
225K-400K Annually
Expert/Leader
225K-400K Annually
Expert/Leader
Artificial Intelligence • Software • Conversational AI • Generative AI
As a Research Engineer, you will tackle AI safety challenges, develop evaluation methodologies, conduct adversarial testing, and work on model alignment and interpretability. You'll bridge theoretical and practical applications of AI safety research and collaborate with product teams to implement safety solutions.
Top Skills: Ai SafetyData PipelinesDockerExplainable AiGpusKubernetesMachine LearningReinforcement LearningTransformers
11 Minutes Ago
In-Office or Remote
United States
76K-126K Annually
Junior
76K-126K Annually
Junior
Big Data • Information Technology • Software • Analytics • Energy
Configure, test, and implement Automated Utility Design software for electric utility clients. Translate client standards into software configurations, lead requirements workshops, support testing and training, troubleshoot technical issues, document solutions, and track project delivery. The role combines utility design or drafting experience with software configuration, client-facing consulting, and basic programming knowledge.
Top Skills: .NetAutocad Map 3DAutodesk AutocadC#Esri ArcgisGe SmallworldGisPythonSbs Automated Utility Design (Aud)SQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account