Raydar Logo

Raydar

AI Engineer

Posted 10 Days Ago
In-Office
San Francisco, CA, USA
150K-220K Annually
Entry level
In-Office
San Francisco, CA, USA
150K-220K Annually
Entry level
Design and deliver scalable, safe conversational AI agents for regulated environments. Coordinate multiple agents, monitor production traces, create evaluation cases, improve agent frameworks, integrate external data sources, and support consistent conversations across voice, text, and email. The role requires hands-on experience shipping conversational agents and AI applications at scale, plus evaluation and tracing infrastructure experience.
The summary above was generated by AI

About the company

Our client is a fast-growing technology company.

The role

Raydar is recruiting for this role on behalf of our client. Own the design and delivery of a conversational AI agent that interacts with consumers at large scale, covering the full cycle from production monitoring through evaluation to iterative improvement. This is an early, high-ownership engineering position where the agent must be both scalable and safe in a regulated setting.

What you'll do

- Coordinate multiple AI agents working together across many parallel programs.

- Review production traces, spot problem scenarios in real conversations, and turn them into evaluation cases.

- Use evaluation results to strengthen the core agent framework.

- Connect external data sources so the agent can reach people at the right moments and respond quickly when new demand appears.

- Scale language-model conversations across voice, text messaging and email while keeping them consistent and personalized.

- Follow developments in agent tooling and research and fold the best ideas into the core software platform.


Requirements

What we're looking for

- A background as an engineer dedicated to agentic systems and large AI applications, for example as an agent engineer, applied AI engineer or startup founder.

- Hands-on experience delivering conversational agents and the frameworks around them at scale, in text or voice.

- Experience developing evaluation and tracing infrastructure for AI agents.

- Bachelor's degree in computer science, mathematics or a related field.

- A strong work ethic and the ability to get yourself unblocked.

- Availability to work in person in the Bay Area and begin within about a month.

Bonus points

- Time spent at an agent-focused startup or a leading AI research lab.

- A track record shipping AI products or conversational experiences aimed at everyday users.

- Interest in or prior exposure to health technology.


Benefits

Compensation and benefits

- Base salary: USD 150,000 to 220,000 per year

- Equity

Location and work model

- San Francisco Bay Area, CA, United States

- On-site, 6 days per week in the office

- Full-time

Similar Jobs

Yesterday
Easy Apply
In-Office
San Francisco, CA, USA
Easy Apply
250K-400K Annually
Entry level
250K-400K Annually
Entry level
Enterprise Web • Mobile • Professional Services • Software
Conduct research on AI evaluation, rubrics, benchmarks, human judgment, preference data, and agent performance. Design rigorous experiments, validate measurement frameworks, build evaluation pipelines, and create long-horizon real-user benchmarks. Collaborate with engineers, delivery teams, customers, academics, and external labs, while publishing methods and benchmark findings. The role combines applied statistics, messy human data, research prototyping, technical writing, and deployment of research methods in live customer programs.
Top Skills: Ai Coding ToolsElixirKotlinLlm-As-Judge EvaluationPythonReactSwift
Yesterday
Hybrid
2 Locations
197K-246K Annually
Mid level
197K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Build and deploy scalable, responsible AI systems, including foundation models, LLM inference, agentic workflows, vector search, guardrails, evaluation, governance, and observability. Optimize model training and inference for cost, latency, throughput, and hardware utilization. Own complex AI architectures, define reliability objectives, lead technical reviews, ensure security and compliance, contribute to platform roadmaps, and mentor engineering staff.
Top Skills: AWSAws UltraclustersAzureC#C++CudaGoGCPHugging FaceJavaPythonPyTorchScalaVectordbs
Yesterday
Hybrid
2 Locations
197K-246K Annually
Mid level
197K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, deploy, and support large-scale AI systems, including foundation model training, LLM inference, agentic workflows, similarity search, guardrails, evaluation, governance, and observability. Optimize AI systems for cost, latency, throughput, scalability, and hardware utilization. Own complex architectures, define reliability objectives, lead technical reviews, ensure security and compliance, and mentor engineering teams.
Top Skills: Aws UltraclustersAzureC#C++CudaGoGoGCPGraphragHugging FaceJavaMlxPythonPyTorchScalaVectordbs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account