Raydar Logo

Raydar

Applied AI Engineer

Posted 4 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
200K-275K Annually
Entry level
In-Office
San Francisco, CA, USA
200K-275K Annually
Entry level
Build and evaluate production AI agents, develop reliability and quality evaluation frameworks, improve information storage and retrieval, and convert applied research into measurable production infrastructure. The role includes designing research programs, measuring agent action sequences, optimizing inference cost, and helping guide applied research priorities.
The summary above was generated by AI

About the company

Our client is a fast-growing software company.

The role

Raydar is recruiting for this role on behalf of our client. Build and evaluate AI agents that run in production, turning new research into working systems that handle live data under strict reliability targets. The role blends hands-on engineering with experimentation, and gives the successful candidate ownership of how results are measured and shipped.

What you'll do

- Design and run applied research programs on model reliability, inference cost and output quality.

- Build evaluation frameworks that judge the full sequence of an agent's actions, not only its final output.

- Contribute to how automated assistants store, look up and use prior information.

- Convert research findings into production infrastructure with measurable impact.

- Help set the direction and priorities of the applied research work.


Requirements

What we're looking for

- Experience at high-growth technology companies or AI research labs.

- A practical record of building sophisticated automated software and networked computing systems.

- Background designing testing tools that measure how automated assistants perform.

- Proficiency in Python programming.

- A background from a top university.

- A clearly demonstrable track record, such as an Olympiad result, a major hackathon win, a widely used open-source project or published AI research.

Bonus points

- Quantitative analytics background, including work in finance.

- Experience with knowledge graph systems, reinforcement learning for agents, production machine learning or post-training of models.


Benefits

Compensation and benefits

- Base salary: $200K to $275K per year

- Equity

- Health, dental and vision coverage

- Life and disability insurance

- 401(k) retirement plan with automatic enrollment

- Unlimited paid time off

- Paid sick leave, company holidays and bereavement leave

- Paid parental leave

- Mental health support and virtual care

- Fertility and family-building support

Location and work model

- San Francisco, California, United States

- On-site, 5 days in-office

- Full-time

Similar Jobs

4 Days Ago
Easy Apply
Remote or Hybrid
Santa Clara, CA, USA
Easy Apply
180K-225K Annually
Senior level
180K-225K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Build and deploy secure, production-grade AI solutions for go-to-market teams using retrieval, structured-data querying, and agentic workflows. Partner with GTM leaders to define AI strategy, roadmaps, and build-versus-buy decisions. Establish monitoring, evaluation, security, and ROI frameworks tied to revenue outcomes. Drive adoption through enablement and feedback loops, develop reusable AI architecture and data connectors, improve engineering standards, and mentor other engineers.
Top Skills: A/B TestingAgent-To-Agent (A2A) FrameworksAgentic WorkflowsCloud PlatformsGraphragKnowledge GraphsLlm-As-JudgeModel Context Protocol (Mcp)PythonRegression TestingRetrieval-Augmented Generation (Rag)
10 Days Ago
Hybrid
San Francisco, CA, USA
157K-252K Annually
Senior level
157K-252K Annually
Senior level
Security • Software • Cybersecurity • Automation
Lead applied AI research focused on information retrieval, RAG, agentic workflows, ranking, reasoning, and evaluation. Build prototypes, golden datasets, quality metrics, regression detection, and experimentation frameworks; investigate failure modes and validate improvements through rigorous testing. Collaborate with AI and software engineers to productionize successful approaches and stay current with research in RAG, agents, LLM evaluation, and relevance modeling.
Top Skills: A/B TestingCross-EncodersEmbedding ModelsGenerative AiGraph Link PredictionHybrid SearchInformation RetrievalKnowledge GraphsLearning-To-RankLlm RerankersMachine LearningNlpPythonRagSemantic RoutingVector Databases
17 Days Ago
Hybrid
5 Locations
124K-280K Annually
Senior level
124K-280K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Leads global teams developing production AI, GenAI, RAG, agentic workflow, and MLOps solutions for health systems and health plans. Translates clinical, financial, and operational challenges into HIPAA-compliant use cases involving clinical decision support, population health, revenue cycle, research, and optimization. Oversees healthcare data science engagements, model governance, executive stakeholder communications, client delivery, and team development.
Top Skills: Anthropic ClaudeAws BedrockAws SagemakerAzure Health Data ServicesAzure Machine LearningAzure Openai ServiceChromaCi/CdDatabricksGitGoogle Vertex AiKerasLangchainLlamaindexMlopsNoSQLPandasPineconePythonRagScikit-LearnSemantic KernelSnowflakeSQLTransformers

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account