Senior Software Engineer, QA Automation

About Us
👏 Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.
🔥 Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
📈 400+ healthcare orgs signed in 16 months.
⚡️ $25M raised from YC, Amity Ventures, Sequoia scouts, and more.
🌎 $1T+ market opportunity. We’re going after all of it.

About the Role

We are seeking a Senior Software Engineer to lead Sully.ai’s QA automation strategy. This role is focused on building and scaling automated testing frameworks to ensure release confidence, speed, and reliability. You will partner closely with engineering and product teams to enforce test coverage, prevent regressions, and enable Sully.ai to ship with confidence at scale.

Key Responsibilities

• Design, implement, and maintain end-to-end automated test frameworks across frontend, backend, and integrations.

• Ensure every release is protected by automated regression tests and critical path validation.

• Partner with engineering teams to enforce test-first development practices.

• Continuously improve test coverage, speed, and reliability while reducing manual QA overhead.

• Serve as QA automation subject matter expert, mentoring peers and introducing best practices.

Hard Requirements

• 5+ years of software engineering experience with a focus on automated testing.

• Proven expertise in test frameworks (e.g., Cypress, Playwright, Selenium, Jest, PyTest).

• Strong programming background in React, Node.js/Python, LLM integrations.

• Experience with CI/CD pipelines and integrating automated tests into deployment workflows.

• Track record of improving software reliability and release confidence at scale.

Nice-to-Have

• Healthcare, EHR, or compliance-driven testing experience.

• Familiarity with HIPAA, SOC2, or similar quality/security standards.

• Performance and load testing experience.

First-Month Focus

• Audit existing test frameworks and coverage gaps across core products.

• Define strategy and tools for achieving complete test automation for Receptionist.

• Establish initial reliability metrics for release readiness.

Success OKRs (90 Days)

• Achieve 100% automated test coverage & release protection for Receptionist/Voice AI Agent.

• Reduce manual QA involvement by 50% while maintaining or improving quality.

• Implement automated regression suite integrated into CI/CD for all major releases.

Culture Fit

• Persistent, driven problem solver

• Willing to push back on leadership to defend quality/timelines

• Thrives in high-ambiguity, fast-paced startup environments

Why Join Sully.ai?
🔥 Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
📈 Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
🌎 Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
💰 Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
🏆 Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.