Model Evaluation and Threat Research, Inc. Logo

Model Evaluation and Threat Research, Inc.

Chief Information Security Officer

Reposted 2 Days Ago
Be an Early Applicant
In-Office
Berkeley, CA, USA
493K-579K Annually
Expert/Leader
In-Office
Berkeley, CA, USA
493K-579K Annually
Expert/Leader
Lead METR’s organizational security function, advise leadership on security risks, set the security roadmap, build security culture, and manage security engineers and contractors. Responsibilities include incident response, infrastructure hardening, red teaming, threat modeling, partnership security requirements, and hands-on investigation of IAM, sandboxing, identity, and endpoint security. The role may also involve securing AI/ML systems and agent infrastructure.
The summary above was generated by AI
About METR

We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment.

We believe it is robustly good for policymakers and civil society to have a clear understanding of risks from AI systems, and we are extremely excited to build a team of ambitious, excellent people to tackle one of the most important challenges of our time.

About the role

    METR’s mission of enabling transparency and coordination about the risks of frontier AI requires a high degree of trust from frontier AI labs, governments, and the public. As misalignment incidents become more extreme and confidential information about models and frontier AI labs becomes more valuable, we expect to be under increasingly intense pressure from external actors and internal agents. 

    As METR’s CISO, you will own METR’s overall security posture, proactively planning against future threats and ensuring our security strategy grows as the organization does. This includes managing penetration testing, threat modeling, incident investigation and response, and preventing our internal agents from undermining our security posture, covering both technical and administrative security. This role does not involve building or managing a large engineering team, although you will be working closely with our platform, infrastructure, and operations teams. 

    We expect this role to be essential as METR scales - our values, brand and mission requirements imply taking security and confidentiality very seriously. We must be justifiably viewed as secure, professional, and reliable, and are willing to impose costly actions on our staff to achieve this.

What this role looks like

  • Setting organizational strategy: You will set our security roadmap and our security culture, consolidating ownership of security areas that today are spread across teams and filling gaps that currently have no owner. 

  • Advising METR leadership, engineering and operations: You will advise on the security implications of new partnerships, evaluation programs, and model access arrangements before commitments are made. 

  • Owning incident response, red teaming and pen testing. You will lead these efforts across METR, including both computer and people security.

Required Skills

  • Deep security background. You’ve been accountable for an org’s security posture or led high-stakes security engagements in the past, including being part of or leading an IR team. Experience in an industry handling highly sensitive data (e.g., defense, healthcare) is especially desirable.

  • Threat modeling and red teaming experience. You can reason about defending against both insiders and sophisticated, well-resourced adversaries.

  • Excellent communication. You are comfortable explaining complex threat models and policies to executive leadership, and to researchers across a growing organization.

  • Mission-aligned. You care deeply about METR’s mission of investigating catastrophic risks for AI.

Nice-to-haves

  • Built a security team from scratch (first security hire or founding CISO).

  • Led incident response end to end, including decision-making and communication to stakeholders.

  • Experience securing AI/ML systems or agent infrastructure.

  • Familiarity with the tooling in our environment: DataDog, Kubernetes, CrowdStrike Falcon, Okta, Tailscale, Pulumi, PostgreSQL.

Our Culture
 
METR is a mission-driven organization. We believe our work can meaningfully shape humanity's future for the better, and we want to be the best people in the world doing this work. We have a tight-knit, collaborative research culture rooted in truth-seeking and integrity. We're fiercely committed to producing high-quality, trustworthy science. We're honest and transparent about our results, especially when they may go against the grain. We've earned trust as reliable partners who handle confidential information with care. We maintain a low-ego, drama-free environment focused on what matters.
 
Hybrid Requirements: Our technical team members are in our office in Berkeley 3-5 days/week. Please let us know in your application if this is a constraint. If you lack US work authorization and would like to work in-person (strongly preferred), we can likely sponsor a cap-exempt H-1B visa for this role.
 
We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position.
 
We are committed to diversity and equal opportunity in all aspects of our hiring process. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We welcome and encourage all qualified candidates to apply for our open positions.

Similar Jobs

28 Days Ago
In-Office
San Francisco, CA, USA
350K-470K Annually
Expert/Leader
350K-470K Annually
Expert/Leader
Fintech • Payments • Financial Services
Leads Trustly’s global information security and IT organizations, defining security strategy, architecture, risk management, compliance, SOC operations, incident response, and resilience programs. Oversees enterprise IT, infrastructure, workplace technology, vendors, disaster recovery, and AI-driven productivity initiatives. Advises the executive team and Board on cyber risk, regulatory requirements, and technology resilience while managing global teams and relationships with regulators, auditors, and strategic partners.
Top Skills: AIAPIsAWSAzureBlue TeamCcpaDevsecopsDoraGCPGdprIdentity And Access ManagementIso 27001Open BankingPci DssRed TeamSecurity Operations CenterSoc 2Threat Intelligence
An Hour Ago
In-Office
126K-165K Annually
Expert/Leader
126K-165K Annually
Expert/Leader
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Leads safety, strategy, financial performance, governance, operations, customer relationships, and service delivery across a defined geographic or business area. Oversees project teams, budgets, cost-efficiency initiatives, compliance, execution quality, performance reviews, coaching, customer escalations, and adjacent sales opportunities. Requires extensive project management and leadership experience with financial responsibility, strong stakeholder management skills, and regional travel as needed.
An Hour Ago
Hybrid
San Jose, CA, USA
249K-399K Annually
Expert/Leader
249K-399K Annually
Expert/Leader
AdTech • eCommerce • Information Technology • Software • Travel • Generative AI
Lead AI-powered reporting and insights strategy, design reporting data architecture and pipelines, and implement LLM-powered workflows (RAG, prompt engineering, agentic pipelines). Integrate BI tools and enterprise AI platforms, establish governance for AI outputs, and provide technical leadership to deliver trusted executive insights and scalable self-service reporting.
Top Skills: AnthropicAws BedrockAzure OpenaiDatabricksDelta LakeFlinkGoogle Vertex AiIcebergLangchainLlamaindexLlmLookerPythonRagSnowflakeSparkSQLTableau

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account