Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
Anthropic's Safeguards team plays a critical role in ensuring our AI systems are deployed safely, responsibly, and in line with our values.
As an Incident Manager, you will manage Safeguards incidents involving our AI systems from declaration through closure. You will assess severity, bring in the right people from Legal, Communications, Policy, Threat Intelligence, Security, Engineering, and research teams, keep leadership informed, and see follow-up work through. You will also oversee the Safeguards Enforcement on-call queue on a rotating basis, and help build and scale the incident response program, including runbooks, post-incident reviews, and automation of routine work.
Important context for this role: in this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a violent, sexual, or psychologically disturbing nature. This role also includes after-hours and weekend incident coverage on a rotating basis.
Key responsibilitiesServe as incident commander for Safeguards incidents from declaration through closure
Assess what qualifies as an incident, propose severity, and coordinate responders across Legal, Communications, Policy, Threat Intelligence, Security, Engineering, and research teams
Keep everyone working from the same facts by tracking input from each team, establishing what is known, what has changed, and what is still open, and sending regular updates that executives and partner teams rely on
Make sure Legal, Communications, and Public Policy are consulted before decisions that need them, and coordinate any external notifications
Run post-incident reviews, assign action items to named owners, and track them through closure
Oversee the on-call queue during your rotation as the first responder for urgent requests and escalations to Safeguards Enforcement
Triage each request, resolve what you can, route the rest to the owning team, and recognize when a request is the start of an incident
Take part in after-hours and weekend incident coverage on a rotating basis
Scope and deliver projects that improve the incident response program, such as on-call automation, incident readiness, and post-incident reviews and metrics
Draft and maintain runbooks and standard operating procedures
Work with Safeguards engineers to automate or reroute requests by writing the decision rules and testing the result
Maintain the incident record and the metrics that show leadership how the program is performing
Experience running incidents or urgent escalations from start to finish in trust and safety, security, platform integrity, crisis management, or a comparable field, and readiness to lead high-severity incidents with support
Hands-on experience with incidents where someone was abusing or misusing a product or platform, such as account compromise, fraud, or coordinated malicious activity
Ability to make clear decisions under time pressure, record your reasoning, and recognize when a decision belongs to Legal, Policy, or leadership
Ability to write short, accurate updates that an executive can act on and that hold up to legal and external scrutiny
Experience coordinating people across many functions who do not report to you, securing their commitments, and following through on them
Experience improving an operational process on your own initiative, and the ability to tell which steps need a person and which can be automated
Willingness to do hands-on queue work as a regular part of the job, and to treat it as a source of information about what is breaking
Ability to participate in after-hours and weekend incident coverage on a rotating basis
Experience joining an incident response function early and helping write runbooks and review processes
Experience with incidents involving AI systems
Experience with the enforcement steps that follow an incident, such as account actions, law enforcement referrals, or user and customer notifications
Experience working with threat intelligence or security investigation teams during an incident
Experience with regulatory or external incident reporting and disclosure
Experience running an on-call rotation or support escalation queue, including setting and measuring response targets
Experience using AI tools to automate triage, summaries, or routine decisions, with checks on quality
Working knowledge of SQL or similar tools for analyzing incident and queue data
Experience designing and facilitating tabletop exercises
Genuine interest in AI safety and responsible technology development
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings.
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.
Anthropic San Francisco, California, USA Office
548 Market St, San Francisco, California, United States, 94104
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
