Medeloop Logo

Medeloop

Staff AI Machine Learning Engineer

Reposted An Hour Ago
In-Office
San Francisco, CA, USA
Senior level
In-Office
San Francisco, CA, USA
Senior level
Lead the design of advanced AI systems for healthcare, develop evaluation frameworks, and drive LLM development while shaping AI strategy in a collaborative environment.
The summary above was generated by AI
The Role

We are seeking a Staff Machine Learning Engineer with deep expertise in agentic AI — and a true passion for experimentation and creation — to design, build, test, evaluate, and productionize next-generation autonomous AI agents for healthcare and clinical research. If you love rapidly prototyping wild ideas, running build-test-learn cycles, iterating on novel agent behaviors, and turning unsolved challenges into working systems, this is the role for you. You will own end-to-end agentic workflows that reason, plan, use tools, orchestrate multi-agent collaboration, and deliver safe, reliable outcomes in highly regulated environments, while collaborating with multidisciplinary teams to influence Medeloop’s technological direction. You will also be nested within a team of advisors and collaborators with deep medical and health expertise, including scientists, clinicians, and AI experts, including the former FDA commissioner, former editor of JAMA, and developer of BloombergGPT. The result: You will be an active participant in fostering a data lead public health and healthcare ecosystem. 

What You'll Own
  • Lead the design and architecture of advanced agentic AI systems, including reasoning loops (ReAct, CoT, ToT), tool-calling, dynamic multi-agent orchestration, RAG pipelines, memory/state management, and emerging protocols like Model Context Protocol (MCP) and Agent-to-Agent (A2A).
  • Build and own production-grade agent infrastructure, including prompts, function tools, workflow graphs, MCP/A2A integrations, and adaptive agent lifecycle management (spinning up, specializing, delegating, and decommissioning agents dynamically for complex healthcare workflows).
  • Develop rigorous evaluation and safety frameworks — automated testing, benchmarking, regression testing, adversarial testing, safety guardrails, observability (tracing, logging, metrics), and human-in-the-loop mechanisms to ensure reliable, compliant performance in production.
  • Drive LLM and ML model development — train, fine-tune, and deploy large-scale models on healthcare datasets, working closely with researchers and clinicians to solve real clinical challenges.
  • Shape Medeloop’s agentic AI strategy and roadmap in close partnership with the C-suite and cross-functional leadership.
  • Stay at the cutting edge of agentic AI (multi-modal agents, advanced reasoning models, interoperability protocols) and help establish Medeloop as a leader in transparent, compliant healthcare AI.
What We're Looking For
  • 7+ years of hands-on experience as a Machine Learning Engineer, with a proven track record building and shipping production agentic AI systems (single- or multi-agent) in industry, ideally in healthcare, life sciences, or other related domains.
  • Experience working on analytic engines (or advanced analytics platforms) — designing, optimizing, or integrating systems that power data-driven insights, queries, or decision-making at scale.
  • Strong theoretical foundation in ML/AI, with emphasis on NLP/LLMs, reinforcement learning, planning/reasoning algorithms.
  • Deep expertise with agentic frameworks and tools: LangChain/LangGraph, Model Context Protocol (MCP), Agent-to-Agent (A2A) protocols, Hugging Face, PyTorch, vector databases/semantic search, prompt engineering, and observability platforms (e.g., LangSmith, Phoenix).
  • Experience designing fully automated evaluation and testing pipelines for autonomous agents and their orchestration, including metrics for reliability, safety, factuality, cost/latency, clinical utility, and dynamic behaviors.
  • A builder/experimenter mindset — you thrive on rapid prototyping, testing bold new ideas, iterating quickly on agent designs, and exploring uncharted territory in agentic systems.
  • Passion for unsolved challenges in healthcare AI, with the ability to thrive in a fast-paced, multidisciplinary environment and wear multiple hats.
Bonus Points
  • Strong record in top AI/ML conferences/journals; experience with healthcare data (EHRs, claims) and regulatory considerations (HIPAA, transparency, reproducibility).
  • Multi-cloud experience (AWS, Azure, GCP)
Why Medeloop
  • Ownership from day one: small team, high-trust, no layers between your work and its impact
  • Technically ambitious: you'll build AI-powered workflows, not just support them
  • Real-world stakes: your work accelerates drug development, addresses health equity, and improves clinical research for institutions that matter
  • Strong foundation: Series A, top-tier investors, and a data asset (200M+ patient records) that most companies spend years trying to build

HQ

Medeloop Menlo Park, California, USA Office

Menlo Park, California, United States

Similar Jobs

6 Days Ago
Hybrid
Mountain View, CA, USA
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design and productionize agentic AI systems and components, improve agent behavior and reliability, create eval benchmarks and high-quality datasets, tune and evaluate LLMs and models, optimize latency and reliability in production, and partner with platform and UI teams to deliver end-to-end ML solutions.
Top Skills: Deep Learning ArchitecturesGoHybrid Vector DatabasesLlmsMultimodal Foundation ModelsPython
20 Days Ago
Hybrid
Sunnyvale, CA, USA
189K-301K Annually
Senior level
189K-301K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Develop and maintain large-scale evaluation, introspection, and visualization tools for autonomous vehicle ML models. Build metrics, dashboards, and pipelines that process billions of examples, collaborate with data, infra, simulation, and modeling teams, and provide technical leadership to align offline evaluation with real-world AV behavior.
Top Skills: BigQueryHigh-Throughput Data StreamingJupyter NotebooksKubernetesNode.jsPythonReactSparkStreamlitTypescriptWebglWebgpu
Yesterday
In-Office
San Jose, CA, USA
163K-253K Annually
Senior level
163K-253K Annually
Senior level
Semiconductor • Manufacturing
Design and productionize agentic multimodal AI applications and multi-agent systems; architect orchestration, routing, state/memory, and human-in-the-loop workflows; build evaluation and benchmarking frameworks; optimize inference on accelerated hardware (quantization, batching, runtime tuning); profile and solve AI acceleration and memory bottlenecks; collaborate with researchers and developers to deploy and operate large-scale LLM/vision systems.
Top Skills: AdkAutogenCC++CrewaiLangchainLanggraphPythonPyTorchTensorFlowTensorrt-LlmVllm

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account