Epsilon Health Logo

Epsilon Health

Research Scientist - Post-training / RL

Reposted 21 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Senior level
In-Office
San Francisco, CA, USA
Senior level
Lead post-pretraining work on multimodal medical vision-language models: fine-tuning, reward modeling, RL (including RLHF), chain-of-thought and tool-use training, inference-time strategies, and publishable research to enable clinically grounded radiology report generation.
The summary above was generated by AI
About Us

We're tackling one of healthcare's most critical challenges in medical imaging and diagnostics. Our company operates at the intersection of cutting-edge AI and clinical practice, building technology that directly impacts patient outcomes. We've assembled one of the industry's most comprehensive and diverse medical imaging datasets and have a proven product-market fit with a substantial customer pipeline already in place.

 
Role Overview

We're seeking a Research Scientist with deep expertise in post-training and reinforcement learning to join our ML Research team. You'll be at the forefront of developing and deploying state-of-the-art multimodal models for clinical use in radiology settings. This role owns every stage after pretraining: supervised fine-tuning, reward modeling, reinforcement learning against verifiable and learned reward signals, reasoning and tool-use training, and inference-time strategy. You'll work with one of the largest and most diverse medical imaging datasets in the industry, advancing the state-of-the-art in grounded report generation, reward design, and inference-time reasoning while maintaining the clinical rigor required for healthcare deployment.

Key Responsibilities
  • Design reinforcement learning with verifiable rewards for report generation, including clinical label and entity-relation matching, grounding IoU, measurement accuracy, and reporting schema compliance.

  • Extend reinforcement learning to unverifiable and noisy objectives such as report quality and clinical usefulness, using learned reward models and radiologist feedback pipelines (RLHF) built on expert preferences and report edits.

  • Run GRPO-family algorithms with complex multi-reward objectives, tuning reward composition and diagnosing reward hacking, entropy collapse, and diversity loss.

  • Train explicit reward models, including multimodal reward models conditioned on the image, with both outcome and process supervision.

  • Train chain-of-thought reasoning over image regions, including evidence localization and verification loops that keep reasoning grounded in the image rather than in language priors.

  • Train multimodal tool use — windowing, zoom and crop, detector and segmentation calls, prior study retrieval — with credit assignment across multi-turn trajectories.

  • Develop inference-time methods including best-of-N sampling against reward models and grounding-aware decoding, and distill the resulting gains back into the policy.

  • Tune output stylization to institutional reporting conventions, keeping style rewards separated from clinical content rewards.

  • Stay current with cutting-edge research in reinforcement learning, reward modeling, and multimodal post-training.

  • Drive research and technical excellence through conference publications and technical blog posts, establishing best practices for post-training medical VLMs at scale.

Qualifications
  • 6+ years of academia/industry experience in reinforcement learning, post-training, or multimodal machine learning

  • Deep expertise in post-training large language or vision-language models (e.g., Qwen-VL, InternVL, LLaVA, or similar architectures)

  • Strong foundation in modern post-training and reinforcement learning techniques including:

    • Group-relative policy optimization and its successors (GRPO, DAPO, GSPO, CISPO) with multi-reward objectives

    • Reinforcement learning with verifiable rewards, and with noisy, sparse, or learned reward signals

    • Reward model training: pairwise and generative reward models, outcome and process supervision

    • Preference optimization methods (DPO, IPO, ORPO, KTO) and RLHF

    • Inference-time compute scaling, including best-of-N sampling and verifier-guided decoding

  • Practical experience diagnosing and mitigating reward hacking and reward over-optimization

  • Track record of implementing complex models from research papers and adapting them to new domains

  • Proficiency in PyTorch or JAX, with experience training large models on multi-GPU/distributed systems

  • Experience with reinforcement learning infrastructure at scale, including rollout generation (vLLM, SGLang) and frameworks such as verl, TRL, or OpenRLHF

  • Experience with autoregressive language modeling and instruction tuning

  • Strong software engineering skills and ability to write production-quality code

Preferred Qualifications
  • Publications at top-tier conferences (NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, MICCAI)

  • Hands-on experience with medical imaging applications, particularly radiology report generation

  • Experience with agentic or multi-turn reinforcement learning, including credit assignment over tool-use trajectories

  • Experience with grounded generation tasks (visual grounding, referring expression comprehension)

  • Knowledge of evaluation methodologies for long-form generation, including factuality assessment and hallucination detection

  • Experience mitigating catastrophic forgetting of supervised capabilities during reinforcement learning

  • Familiarity with clinical NLP and medical knowledge representation

  • Experience with model interpretability, explainability, and uncertainty quantification in safety-critical applications

Similar Jobs

12 Minutes Ago
Remote or Hybrid
Sunnyvale, CA, USA
155K-240K Annually
Expert/Leader
155K-240K Annually
Expert/Leader
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Leads CrowdStrike’s global Partner GTM Programs team, developing and optimizing partner programs, incentives, enablement, and emerging go-to-market strategies. Drives revenue, market share, retention, cross-functional alignment, performance analysis, and joint marketing initiatives. Manages a team, advises senior stakeholders, represents the company at industry events, and continuously improves partnership operations. The role requires 10+ years of relevant partner GTM experience and up to 30% domestic and international travel.
Top Skills: AICybersecurity
12 Minutes Ago
Remote or Hybrid
USA
100K-145K Annually
Junior
100K-145K Annually
Junior
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Develop and maintain SOAR playbooks, PowerShell and Python scripts, SIEM integrations, and AI-powered workflows for CrowdStrike’s Falcon Complete MDR operations. The role automates security enrichment, triage, investigation, remediation, and basic forensic tasks while collaborating with SOC analysts and engineering teams. Responsibilities include data parsing, Git-based version control, identifying automation opportunities, and evaluating emerging SOAR and AI technologies to improve analyst efficiency.
Top Skills: Ai Workflow FrameworksAPIsAWSAzureBitbucketCrowdstrike FalconFalcon SoarGCPGenerative AiGitGitGitlabJSONLlmsLogscaleMitre Att&CkNistPowershellPythonRegular ExpressionsSIEMSoar
20 Minutes Ago
Remote or Hybrid
United States
Entry level
Entry level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Supports Medicare business operations across agent licensing and contracting, compliance and call-quality audits, customer retention, member support, enrollment verification, and seasonal initiatives. Maintains licenses, certifications, carrier access, CRM records, and compliance documentation; conducts welcome, remediation, and retention calls; investigates grievances and resolves member issues. The role is remote and requires an active health insurance license, Medicare certification, strong communication, attention to detail, and familiarity with Medicare regulations and carrier systems.
Top Skills: Carrier PortalsCrm PlatformsMulti-State Licensing SystemsQuotemanageSpreadsheetsZendesk

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account