Cognition Logo

Cognition

Head of Safety

Posted 5 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Expert/Leader
In-Office
San Francisco, CA, USA
Expert/Leader
Lead Cognition’s safety function for Devin and its underlying models. Set safety strategy, build evaluations and red-teaming for agentic risks, shape model training and agent-harness safeguards, establish deployment policies, and hire and lead safety researchers and engineers. The role requires hands-on frontier AI safety or alignment experience, agentic systems expertise, research credibility, technical fluency, and strong judgment under uncertainty.
The summary above was generated by AI
We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

Role Mission

Devin is one of the most capable autonomous agents in production. It writes and runs code, uses tools, takes actions in real customer systems, and operates for hours without a human in the loop. That makes it one of the most important places in the industry to get safety right, and one of the few where safety work ships to millions of developers rather than staying in a paper. You will build Cognition's safety function from the ground up: the research agenda, the evaluation and red-teaming program, the deployment policies, and the team. You will work directly with the researchers training our models and the engineers building the agent harness. This is a hands-on role for someone who has done serious safety or alignment work at a frontier lab and wants to apply it where agents actually operate.

What You'll Accomplish
  • Own safety end to end: Set the safety strategy for Devin and the models behind it, and own the outcomes.

  • Build the evaluation program: Design evals and red-teaming for agentic risk: unsafe actions, prompt injection, data exfiltration, sandbox escape, reward hacking, and misuse. Make them part of every model and product release.

  • Shape training and the agent harness: Partner with pre-training, post-training, and agent teams so safety is built into how models are trained and how Devin plans, acts, and asks for help.

  • Set deployment policy: Define what Devin is and is not allowed to do, how permissions and oversight work, and how we handle the gray areas, in a way that holds up with enterprise customers.

  • Build the team and the external voice: Hire and lead safety researchers and engineers. Represent Cognition's safety work with customers, policymakers, and the broader research community.

Exceptional Candidates Have Demonstrated
  • Frontier lab safety or alignment experience: Hands-on work on safety, alignment, evaluations, or red-teaming at a frontier AI lab. You have shipped safety work that affected real models or products.

  • Agentic systems depth: You understand how agents fail in practice: tool misuse, specification gaming, long-horizon drift, adversarial inputs. You have ideas about how to measure and mitigate it.

  • Research credibility: A track record of published or widely used safety research, evals, or methods. An advanced degree in Computer Science, Machine Learning, or a related field is a plus.

  • Technical fluency: Comfortable in Python and in the training and inference stack. You can read the code, run the evals, and argue with researchers on the details.

  • Builder, not reviewer: You have started or scaled a safety function and prefer shipping mitigations to writing memos about them.

  • Judgment under uncertainty: You can make clear calls on deployment risk with incomplete information and explain them to engineers, executives, and customers.

Our Commitment

Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.

Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement.

HQ

Cognition San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

One Month Ago
Hybrid
San Francisco, CA, USA
311K-447K Annually
Expert/Leader
311K-447K Annually
Expert/Leader
Cloud • Information Technology • Security • Software • Cybersecurity
Lead Cloudflare’s global Trust and Safety organization, overseeing investigators and engineers handling legal information requests, abuse reports, fraud, account security, and sensitive escalations. Develop scalable policies, automated systems, transparency reporting, and fair enforcement processes across global markets. Recruit and manage a 24/7 team, collaborate with Legal, Policy, Security, Product, Engineering, and executives, and represent Cloudflare with regulators, government officials, industry groups, customers, and the press.
Top Skills: AnalyticsArtificial IntelligenceAutomationInternet Infrastructure
2 Months Ago
Hybrid
South San Francisco, CA, USA
188K-505K Annually
Expert/Leader
188K-505K Annually
Expert/Leader
Healthtech • Pharmaceutical
Leads global patient safety and pharmacovigilance strategy for multiple myeloma and AML products across clinical development and post-marketing. Oversees safety surveillance, signal detection, aggregate data analysis, regulatory responses, risk management plans, and periodic safety reports. Leads Product Safety Teams, coordinates cross-functional approval activities, interprets regulations, and mentors medical leadership. Manages Associate Medical Directors, Medical Directors, and Senior Medical Directors while making independent decisions in complex and uncertain situations.
2 Months Ago
Hybrid
188K-505K Annually
Expert/Leader
188K-505K Annually
Expert/Leader
Healthtech • Pharmaceutical
Leads global patient safety strategy for multiple myeloma and AML products across clinical development and post-marketing lifecycles. Oversees pharmacovigilance surveillance, signal detection, aggregate safety analysis, regulatory responses, periodic reports, risk management plans, and product safety activities. Manages medical director teams, coordinates cross-functional safety initiatives, mentors colleagues, and ensures compliance with applicable regulations.
Top Skills: Clinical Data AnalysisEpidemiological AnalysisPadersPharmacovigilancePsursRisk Management PlansSafety SurveillanceSignal Detection

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account