Sully.ai Logo

Sully.ai

Head of Engineering, QA

Reposted 18 Days Ago
In-Office or Remote
2 Locations
200K-230K Annually
Senior level
In-Office or Remote
2 Locations
200K-230K Annually
Senior level
As Head of Engineering, QA, lead the QA strategy, build automation, ensure reliability, and grow a high-performing QA team in an AI healthcare startup.
The summary above was generated by AI

About Us
At Sully.ai, We’re Building the Most Impactful Healthcare Company on Earth

We believe that access to a great doctor is a basic human right. Today, that’s not a reality. Delays, misdiagnoses, administrative chaos, and burnout plague the system.

Our Mission: One Human, One Doctor. We build AI teammates that augment clinicians — scribes, nurses, receptionists, translators — all powered by our own world-class models and deployed in real-world care.

Our Traction

  • 450+ organizations signed 16 months

  • AI agents cut admin by ~2.8 hours daily and reduce onboarding 85%.

  • 5M+ Clinical Tasks completed to date, serving 36+ specialties.

  • Raised $25M from YC, Eric Yuan, Amity, Semper Virens

  • Patented AI architecture (MedCon-1) outperforms GPT-4.5, Gemini, Claude on clinical reasoning tasks

Sully requires A-players capable of 4 months = 1 year output.

What You’ll Do:

Own Sully.ai’s end-to-end QA strategy across automation, functional, performance, and compliance testing.

  • Build and scale Playwright-based automation for UI and API coverage.

  • Expand automation reliability, maintain dashboards, and rapidly diagnose failing tests.

  • Ensure accuracy, security, and compliance (HIPAA/SOC-2) in partnership with Engineering and Clinical teams.

  • Recruit, mentor, and lead a high-performing QA team.

  • Embed QA deeply into CI/CD pipelines using GitHub Actions and supporting tools.

What You Must Bring:
  • Founder / 0→1 experience — built QA from scratch as the first person in function.

  • 6–8+ years in QA with expert-level Playwright experience.

  • 3–4+ years leading and developing QA engineers.

  • Proven track record automating functional UI and API tests.

  • Hands-on depth with Playwright, Cypress, PyTest, and Postman.

  • Experience scaling test automation and improving reliability at speed.

  • High ownership, bias toward action, and comfort operating in early-stage environments.

  • Bonus: AI/LLM QA experience, observability tooling familiarity, GitHub Actions CI/CD, healthcare testing background.

First-Month Focus
  • Define Sully.ai’s QA strategy and initial automation framework.

  • Stand up core Playwright tests for the highest-impact workflows.

  • Align with Engineering and Clinical teams on compliance and testing requirements.

90 Day OKRs
  • Automated test coverage established across critical UI and API workflows.

  • QA pipelines fully integrated into GitHub Actions with reliable CI/CD gates.

  • Clear improvements in test reliability, developer confidence, and release quality.


If you’ve ever said, “I want to do work that actually matters”, this is it. Let’s build something life-changing, together.

Who Thrives Here

  • Entrepreneurial to your core: You think in outcomes, thrive in chaos, and take ownership without limits

  • Mission-obsessed: You’re here to save lives, not just ship features — patients and doctors are your why.

  • Impact-driven & fast-moving: You sprint toward hard problems and ship with sharp judgment.

  • Elite teammate: You raise the bar through high standards, direct feedback, and craft excellence.

Why Join Sully.ai?
🔥 Revolutionizing the antiquated $800B+ Healthcare market

🧠 50%+ of us are ex-founders. We hire A-players, not passengers

⚡️ Speed matters - we operate with urgency, autonomy, and ownership

🧪 You’ll work on real, first-of-their-kind problems at the edge of AI and medicine

❤️ Your work helps doctors reclaim their time - and patients get better, faster care

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment. 

Top Skills

AWS
Azure
Cypress
Docker
GCP
Github Actions
Jmeter
K6
Kubernetes
Locust
Playwright
Pytest
HQ

Sully.ai Mountain View, California, USA Office

883 N Shoreline Blvd, Mountain View, California, United States, 94043

Similar Jobs

16 Minutes Ago
Remote
California, USA
159K-259K Annually
Senior level
159K-259K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Professional Services • Software • Sports • Analytics
Lead a software engineering team to design, develop, and deliver high-quality web and mobile applications, while promoting best practices and guiding technical strategies.
Top Skills: Api GatewayAWSC#FlutterJavaLambdaPythonReactSqs
16 Minutes Ago
In-Office or Remote
Santa Ana, CA, USA
106K-171K Annually
Senior level
106K-171K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Professional Services • Software • Sports • Analytics
The Compensation Manager will oversee compensation benchmarking, annual reviews, bonus and stock plan administration, and collaborate with HR and finance to enforce equitable pay structures. This role also involves enhancing transparency, compliance, and building international compensation programs as the company expands globally.
Top Skills: AdaptiveExcelWorkday
20 Minutes Ago
Remote or Hybrid
United States
136K-253K Annually
Senior level
136K-253K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Lead a team to enhance the Identity Security Cloud Platform by solving complex technical challenges and collaborating with various stakeholders. Manage technical debt and drive productivity.
Top Skills: AWSDockerKafkaKubernetesSqs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account