About the company
Our client is a technology company.
The role
Raydar is recruiting for this role on behalf of our client. Plan and carry out machine learning experiments that clarify how different training data shapes model behavior. Convert the findings into practical recommendations and contribute to shared evaluation tooling, collaborating with outside partners and internal colleagues.
What you'll do
- Run controlled fine-tuning and reinforcement learning experiments to measure how training data affects model performance.
- Help build public evaluations and new kinds of training data.
- Share findings publicly through articles, written reports and similar technical content.
- Partner with internal teams to improve data quality based on experimental findings.
- Present results to external partners as clear, well-supported evidence.
Requirements
What we're looking for
- Strong familiarity with large language model training and evaluation methods.
- Hands-on experience setting up, running and interpreting controlled experiments without close supervision.
- Skill at running quick, small-scale tests and drawing useful conclusions from noisy results.
- Comfort working across several domains, such as finance, software engineering and policy.
- A preference for building and testing over theorizing.
- Prior experience at a leading AI research lab.
- 0 to 4 years of relevant experience.
Benefits
Compensation and benefits
- Base salary: USD 150,000 to 250,000 per year
- Health insurance
Location and work model
- San Francisco, California, United States
- On-site
- Full-time
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine



