Raydar Logo

Raydar

Research Scientist

Posted 3 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
150K-250K Annually
Mid level
In-Office
San Francisco, CA, USA
150K-250K Annually
Mid level
Conduct controlled fine-tuning and reinforcement learning experiments to understand how training data affects model behavior. Develop evaluations and training datasets, assess noisy experimental results, improve data quality, publish technical findings, and present evidence to internal and external partners across domains including finance, software engineering, and policy.
The summary above was generated by AI

About the company

Our client is a technology company.

The role

Raydar is recruiting for this role on behalf of our client. Plan and carry out machine learning experiments that clarify how different training data shapes model behavior. Convert the findings into practical recommendations and contribute to shared evaluation tooling, collaborating with outside partners and internal colleagues.

What you'll do

- Run controlled fine-tuning and reinforcement learning experiments to measure how training data affects model performance.

- Help build public evaluations and new kinds of training data.

- Share findings publicly through articles, written reports and similar technical content.

- Partner with internal teams to improve data quality based on experimental findings.

- Present results to external partners as clear, well-supported evidence.


Requirements

What we're looking for

- Strong familiarity with large language model training and evaluation methods.

- Hands-on experience setting up, running and interpreting controlled experiments without close supervision.

- Skill at running quick, small-scale tests and drawing useful conclusions from noisy results.

- Comfort working across several domains, such as finance, software engineering and policy.

- A preference for building and testing over theorizing.

- Prior experience at a leading AI research lab.

- 0 to 4 years of relevant experience.


Benefits

Compensation and benefits

- Base salary: USD 150,000 to 250,000 per year

- Health insurance

Location and work model

- San Francisco, California, United States

- On-site

- Full-time

Similar Jobs

5 Days Ago
Hybrid
Santa Clara, CA, USA
203K-354K Annually
Junior
203K-354K Annually
Junior
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Conduct research on enterprise agentic AI, including tacit knowledge, continual learning, safety, resilience, privacy, threat detection, and responsible AI. Develop and publish influential research, collaborate with engineering and product teams, maintain production-quality research code, evaluate deployed AI systems, and influence technical decisions across the organization.
Top Skills: Agentic AiAi SafetyArtificial IntelligenceMachine LearningNatural Language ProcessingPrivacy EngineeringResearch SoftwareThreat Detection
5 Days Ago
Hybrid
147K-259K Annually
Entry level
147K-259K Annually
Entry level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Lead research in language models, personalization, recommendation systems, information retrieval, and generative modeling. Build scalable machine learning prototypes, conduct large-scale distributed experiments, publish findings, mentor junior researchers and interns, and partner with engineering teams to deploy technologies serving Snapchat users. The role requires strong Python and PyTorch expertise, research leadership, publications, and experience applying language models to search, ranking, or personalization.
Top Skills: AWSAzureGCPPythonPyTorch
Yesterday
In-Office or Remote
San Francisco, CA, USA
Entry level
Entry level
Security • Software • Generative AI
Conduct hands-on research on frontier AI models, reasoning, agents, and multimodal systems. Design benchmarks, evaluation frameworks, and experimental pipelines; rapidly develop prototypes, run experiments, identify model limitations, and deliver actionable findings. Collaborate with customers, engineering, and product teams to address complex research challenges. Preferred expertise includes AI cybersecurity, autonomous security agents, vulnerability research, LLM red teaming, adversarial machine learning, prompt injection, and agentic AI security.
Top Skills: Adversarial Machine LearningCtfsDynamic Code AnalysisFoundation ModelsLlmsMultimodal SystemsPrompt InjectionPythonPyTorchSecurity Testing FrameworksStatic Code Analysis

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account