The Staff Software Engineer will build backend systems for LLM applications in healthcare, focusing on API design, data pipelines, observability, and system performance optimization.
SuperDial is seeking a Staff Software Engineer, Applied AI to build and scale the backend systems that power LLM applications in healthcare. This role is ideal for an engineer who thrives at the intersection of backend architecture and applied AI, designing APIs, pipelines, and infrastructure that make LLMs reliable, secure, and cost-efficient in production. If you want to push LLMs beyond demos into mission-critical healthcare workflows, we’d love to hear from you.
About the Role:
- Backend for LLMs – Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases.
- Data & Retrieval Pipelines – Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data.
- LLMOps & Observability – Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use.
- Performance & Optimization – Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.
- Security & Compliance – Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications.
- Cross-Functional Collaboration – Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems.
- Technical Leadership – Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design.
About You:
- 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications.
- Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript).
- Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.).
- Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale.
- Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc.
- Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility.
- Excellent system design skills and the ability to align technical architecture with product goals.
Preferred Qualifications:
- Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA).
- Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration.
- Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter.
- Knowledge of responsible AI, safety, and privacy-preserving ML techniques.
- The opportunity to apply cutting-edge AI to one of the world’s most important industries.
- A leadership role with ownership over core ML/LLM systems and influence on technical direction.
- Competitive salary, equity options, and benefits, including health, dental, and vision coverage.
The base pay range for this role is $200,000 – $275,000 per year.
Similar Jobs
Machine Learning • Payments • Security • Software • Financial Services
Lead the design and development of ETL solutions for regulatory risk compliance at PNC, requiring advanced programming skills and collaboration on data-intensive applications.
Top Skills:
AlteryxCa7 Job SchedulerDevops ToolsInformatica Powercenter 9.6Microsoft Power BiOracle SqlPl/SqlTableauTeradataUnix Shell Scripting
Artificial Intelligence • Cloud • Software
Own and define IAM strategy for corporate and production environments. Migrate Okta to Terraform, design least-privilege access, automate provisioning/deprovisioning and access reviews, build/manage MDM/MAM tooling, partner with platform and engineering teams, and serve as the IAM subject matter expert across Security, IT, and Engineering.
Top Skills:
Api AutomationAws IamAzure AdGcp IamGoogle WorkspaceIntuneJAMFMamMdmMfaOidcOktaSAMLScimSsoTerraform
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Designs and supports ASIC, FPGA, and mixed digital systems for aerospace and defense programs. Responsibilities include requirements development, architecture support, HDL/RTL development, simulation, debugging, synthesis, FPGA implementation, timing analysis, verification collaboration, integration, troubleshooting, and technical status communication. The role may involve owning functional blocks, supporting subsystem efforts, and contributing to cross-functional technical leadership depending on experience level.
Top Skills:
AsicClock-Domain Crossing (Cdc)FpgaHdlRtlSocStatic Timing AnalysisVlsi
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
