Principal Engineer – Platform Engineering

Hippocratic AI is the leading generative AI company in healthcare. We have the only system that can have safe, autonomous, clinical conversations with patients. We have trained our own LLMs as part of our Polaris constellation, resulting in a system with over 99.9% accuracy.

Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Location Requirement

We believe the best ideas happen together. To support fast collaboration and a strong team culture, this role is expected to be in our Palo Alto office five days a week, unless otherwise specified.

We are seeking a Principal Engineer – Platform Engineering to design, scale, and evolve the infrastructure that powers our AI models and SaaS applications across multiple clouds.

You’ll define the technical direction for our platform, architect systems for large-scale model training and inference, and help with hiring and mentoring engineers. This role blends deep hands-on engineering with technical leadership, partnering closely with AI research and product engineering teams to deliver secure, high-performance, and cost-efficient systems.

• Architect and scale the multi-cloud platform for AI inference and SaaS workloads.

• Lead design for performance, reliability, and cost optimization.

• Build automation and tooling using infrastructure-as-code and CI/CD best practices.

• Partner with research to productionize models efficiently.

• Improve observability, telemetry, and incident response.

• Foster a culture of technical and operational excellence

• Hire and mentor strong engineers to guide long-term technical strategy.

• Evaluate emerging technologies in AI infra, GPU orchestration, and distributed systems.

Must-Have:

• 12+ years in software engineering with strong experience in platform or distributed systems.

• Deep knowledge of AWS, GCP, or Azure, and multi-cloud architectures.

• Expertise in IaC tools (Terraform, Pulumi) and CI/CD automation.

• Experience with Kubernetes, GPU orchestration, or model-serving (e.g., Ray, Triton, SGLang).

• Proficiency with observability tools (Prometheus, Grafana, OpenTelemetry, Datadog).

• Strong understanding of cloud security, networking, and cost optimization.

• Excellent communicator and mentor; strong cross-team collaboration skills.
  

Nice-to-Have:

• Experience with LLM or AI infrastructure, including large-scale inference or fine-tuning.

• Background in data pipelines or developer platform tooling.

• Exposure to hybrid-cloud or edge AI systems.

• Track record of technical leadership and long-term architectural vision.

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.