Eli Lilly and Company Logo

Eli Lilly and Company

Scientific Lead, Generative AI Engineer, Applied Intelligence for Discovery

Reposted 16 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
182K-284K Annually
Senior level
In-Office
San Francisco, CA, USA
182K-284K Annually
Senior level
Lead design and delivery of production LLM systems for drug discovery: build RAG pipelines, hybrid retrieval, text-to-SQL, agentic workflows, evaluation frameworks, and orchestration for scientific analyses.
The summary above was generated by AI

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world.

The Opportunity

We are building something unprecedented, an AI foundation that will fundamentally change how drug discovery research is conducted.

The Applied Intelligence for Discovery (AI4D) team is a newly formed group within Lilly Research Laboratories that operates at the intersection of scientific delivery and core platform development. AI4D’s mission is to connecting scientists to petabyte-scale data through natural language interfaces, automated analysis workflows, and intelligent search — and to convert early deployments into repeatable system standards and evaluation practices that scale across therapeutic areas.

As a Generative AI Engineer, you will design, build, and operate the core AI systems that power this transformation: retrieval-augmented generation over internal scientific documents, text-to-SQL over complex omics databases, agentic workflows that automate multi-step analyses, and the evaluation infrastructure that able the next-generation of medicines for patients.

Key Responsibilities

  • Design, build, and optimize RAG pipelines over internal publications, study reports, electronic lab notebooks, and other scientific documents

  • Build hybrid retrieval systems combining vector search with structured metadata, knowledge graphs, and ontology-aware filtering

  • Build and optimize text-to-SQL systems over Lilly’s databases, enabling scientists to query gene expression, proteomics, pathway, and variant data through natural language

  • Develop schema documentation, semantic annotations, and gold-standard question/SQL pairs that bridge how scientists think about data and how it is stored

  • Implement multi-step reasoning approaches (chain-of-thought, self-correction, Reflexion loops) to improve accuracy on complex scientific queries

  • Design agentic AI workflows that chain database queries, bioinformatics tools, literature search, and visualization into automated multi-step scientific analyses

  • Evaluate and integrate emerging orchestration frameworks (LangGraph, CrewAI, custom architectures) for scientific use cases

  • Build evaluation frameworks measuring accuracy, reliability, and scientific validity of AI outputs

Basic Qualifications

  • PhD in Computer Science, Data Science, or a related technical field with 0-3+ years of experience; or equivalent experience building production LLM systems; MS in Computer Science, Data Science, or a related technical field with 5+ years of experience; or equivalent experience building production LLM systems

Additional Skills/Preferences

  • Experience building LLM-powered applications, including at least two of: RAG systems, text-to-SQL, agentic workflows, or fine-tuning pipelines

  • Strong software engineering skills in Python with experience building production-grade systems

  • Deep familiarity with the modern LLM ecosystem: embedding models, vector databases, and orchestration frameworks

  • Experience designing evaluation frameworks for LLM systems — systematic approaches to measuring accuracy, detecting hallucinations, and tracking regressions

  • Comfort working with complex, heterogeneous data — databases with hundreds of tables, specialized schemas, or domain-specific vocabularies

  • Familiarity with cloud computing environments (AWS preferred), containerization (Docker), and CI/CD practices

  • Experience in pharmaceutical, biotech, or life sciences environments

  • Familiarity with biomedical data types (omics, clinical, molecular) or scientific databases

  • Experience with MLOps/LLMOps tooling: experiment tracking, model registries, prompt versioning, A/B testing for AI systems

  • Knowledge of biomedical ontologies (Gene Ontology, MeSH, ChEBI) or experience integrating domain-specific knowledge into LLM systems

  • Experience building for regulated environments where auditability, reproducibility, and explainability are requirements

Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.

Lilly is proud to be an EEO Employer and does not discriminate on the basis of age, race, color, religion, gender identity, sex, gender expression, sexual orientation, genetic information, ancestry, national origin, protected veteran status, disability, or any other legally protected status.


Our employee resource groups (ERGs) offer strong support networks for their members and are open to all employees. Our current groups include: Africa, Middle East, Central Asia Network, Black Employees at Lilly, Chinese Culture Network, Japanese International Leadership Network (JILN), Lilly India Network, Organization of Latinx at Lilly (OLA), PRIDE (LGBTQ+ Allies), Veterans Leadership Network (VLN), Women’s Initiative for Leading at Lilly (WILL), enAble (for people with disabilities). Learn more about all of our groups.

Actual compensation will depend on a candidate’s education, experience, skills, and geographic location.  The anticipated wage for this position is

$181,500 - $283,800

Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly’s compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees.

#WeAreLilly

Similar Jobs

An Hour Ago
Remote or Hybrid
California, USA
141K-229K Annually
Senior level
141K-229K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Design, build, and operate scalable AWS-based backend services and APIs for the Collectors Vault. Own architecture and delivery, improve performance and reliability, mentor engineers, and leverage modern AI tools to accelerate development and engineering velocity.
Top Skills: APIsAWSC#Claude Code CliCodexEvent-Driven ArchitecturesJavaServerless
An Hour Ago
Remote or Hybrid
US
141K-229K Annually
Senior level
141K-229K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Lead backend and full-stack work on the Payments team, building multi-gateway integrations (Stripe, PayPal), payment APIs, and customer payment UIs. Ensure secure, compliant (PCI-DSS) payment flows, reliability, observability, and scalability across AWS/Kubernetes microservices. Partner cross-functionally to design architecture, implement settlement/reconciliation, and maintain high availability.
Top Skills: .NetAi-Assisted Development ToolsAWSC#DatadogDynamoDBKafkaKubernetesPaypalPci-DssPostgresReactStripeSvelteTypescript
An Hour Ago
Remote or Hybrid
California, USA
141K-229K Annually
Senior level
141K-229K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Build and operate the Power Packs customer experience and backend services. Design data foundations, APIs, and integrations across platform services. Troubleshoot distributed systems, contribute full-stack plumbing as needed, improve observability and documentation, and collaborate with Product and partner teams to deliver scalable, multi-tenant marketplace capabilities.
Top Skills: Apache KafkaAWSAws LambdaClaudeDockerDynamoDBEcsJavaKubernetesNode.jsPostgresPytestPythonSpring BootTypescriptUnittest

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account