Handshake Logo

Handshake

Strategic Projects Lead, Safety

Posted 8 Days Ago
Be an Early Applicant
In-Office
New York, NY
Junior
In-Office
New York, NY
Junior
Own end-to-end AI safety and red-teaming programs for frontier AI labs. Design adversarial testing and jailbreak methodologies, evaluate models across high-severity harm categories and agentic settings, lead expert testing teams, partner with policy stakeholders, synthesize findings into reports, and develop workforce models to improve delivery reliability.
The summary above was generated by AI
About Handshake

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

Why join Handshake now:

  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel

  • Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions

  • Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders

  • Build a massive, fast-growing business with billions in revenue

About Handshake AI

Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.

 
The Role

As a Strategic Projects Lead (SPL) on AI Safety & Red Teaming, you will own the execution of large-scale adversarial testing programs that directly develop frontier AI models before and after release. You will design and run structured efforts to push models to failure, spanning work such as evaluating harm and policy categories against frontier labs’ own policy specifications, developing jailbreak and adversarial technique pipelines, and extending red-teaming into agentic settings, among other methods, then work directly with frontier labs to turn what you find into sharper policies and stronger evaluation coverage.

Working hands-on with leading AI labs, you will make real-time decisions that affect delivery quality, program scope, and long-term customer relationships. This is a high-ownership, outcomes-driven role for operators who thrive in ambiguity, move fast with incomplete information, and are accountable for results at scale.

  • Own end-to-end execution of red-teaming and safety evaluation programs spanning sensitive, high-severity harm categories, from scoping through delivery

  • Run multiple programs across different frontier labs and policy domains, each with its own scope, harm categories, and stakeholders

  • Design and run adversarial testing methodologies, such as jailbreak technique development and iterative push-to-failure testing, to surface model vulnerabilities against frontier labs’ policies

  • Extend red-teaming methods into agentic contexts, evaluating how models behave under adversarial pressure when operating with tools and multi-step autonomy

  • Lead and coordinate teams of expert Fellows executing sensitive, high-stakes testing work, maintaining precision and consistency across harm categories, languages, and markets

  • Partner directly with policy leads at frontier AI labs to identify coverage gaps, ambiguous classifications, and emerging risk areas, and help shape policy documents based on findings

  • Synthesize testing data into insight reports that surface trends, systemic gaps, and recommended areas of policy and evaluation development

  • Design and adapt staffing models for your red-teaming workforce (team size, skill mix, training, and incentive structures) to improve throughput and delivery reliability as program requirements evolve

You Have
  • 2+ years of experience in trust & safety, red-teaming, security research, policy enforcement, or a related technical/analytical field

  • Excellent project and workforce management skills, comfortable leading and directing teams of red-teamers and testers against tight timelines and shifting scope

  • Strong analytical and first-principles problem-solving skills, comfortable operating in ambiguous, fast-changing testing environments

  • Working familiarity with adversarial testing concepts (jailbreak techniques, prompt-based exploits) or a fast ability to pick them up

  • Exceptional communication and stakeholder management skills, including with senior customers and policy teams at frontier AI labs

  • High ownership mindset with pride in end-to-end accountability

  • Curiosity and ability to quickly learn technical AI concepts, model behavior, and industry trends

Bonus Points
  • Experience red-teaming, jailbreaking, or adversarially evaluating LLMs or agentic AI systems

  • Subject matter expertise in high-severity policy harms (e.g., CBRN, cyber, violent extremism)

  • Experience running testing or evaluation programs

  • Background in security research, offensive security, or AI safety research

Note: This role involves exposure to sensitive or explicit content (e.g., violent, sexual, or otherwise disturbing material) as part of safety and policy evaluation work.

We Offer

Handshake delivers benefits that help you feel supported—and thrive at work and in life.
The below benefits are for full-time US employees.

🎯 Ownership: Equity in a fast-growing company
💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching
🍼 Family Support: Paid parental leave, fertility benefits, parental coaching
💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend
📚 Growth: $2,000 learning stipend, ongoing development
💻 Remote & Office: Internet, commuting, and free lunch/gym in our SF office
🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days
🤝 Connection: Team outings & referral bonuses

Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers.

HQ

Handshake San Francisco, California, USA Office

We're located right in the center of everything in the financial district of downtown San Francisco. We're just 1 block from Montgomery St Bart!

Similar Jobs

41 Minutes Ago
Hybrid
79K-119K Annually
Mid level
79K-119K Annually
Mid level
Digital Media • Information Technology • News + Entertainment
Develop and maintain BI reporting for Digital TV business metrics, analyze large datasets to identify sales, inventory, and yield opportunities, and build automated reporting solutions. Collaborate with business and technology stakeholders on product features and processes, create ETL workflows, ensure data quality, and implement AI-powered analytics to support faster data-driven decisions.
Top Skills: Ai-Powered AnalyticsETLLookerExcelPythonRSQLTableau
An Hour Ago
Remote or Hybrid
45-85 Annually
Junior
45-85 Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handles inbound calls and warm leads, consults customers on insurance needs, recommends Property and Casualty coverages, and converts prospects into policyholders. The role includes paid licensing and sales training, customer communication, lead conversion, and schedule adherence in a remote environment. Employees must maintain a professional home workspace and reliable wired high-speed internet while working assigned weekday and weekend shifts.
Top Skills: Cable InternetDsl InternetFiber InternetPc
An Hour Ago
Hybrid
180K-220K Annually
Senior level
180K-220K Annually
Senior level
Events • Social Media • Software
Lead mobile engineering strategy and development for consumer applications using React Native and Expo. Own mobile architecture, performance, accessibility, design systems, testing, CI/CD, and end-to-end app releases. Partner with product and design teams, mentor senior engineers, establish organizational standards, and guide scalable mobile experiences for millions of users.
Top Skills: App StoreCi/CdExpoGoogle Play StoreKotlinReactReact NativeSwift

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account