Head of Engineering, QA at Sully.ai (S21)
$200K - $230K
AutonomousOS for healthcare organizations
Mountain View, CA, US / Remote (US)
Full-time
US citizen/visa only
6+ years
About Sully.ai

Our mission is "One Human, One Doctor". We are creating superhuman doctors, because access to doctors is a basic human right.

Start with making doctors superhuman. Our vision is to eliminate doctor distractions and help them navigate the best treatments for their patients.

About the role

About Us
πŸ‘ Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.
πŸ”₯ Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
πŸ“ˆ 400+ healthcare orgs signed in 16 months.
⚑️ $25M raised from YC, Amity Ventures, Sequoia scouts, and more.
🌎 $1T+ market opportunity. We’re going after all of it.

About the Role
We are seeking a Head of Engineering, QA to build Sully.ai’s QA function from the ground upβ€”owning strategy, automation, and execution. This is a 0β†’1 role: you’ll set the framework for functional, performance, and compliance testing, scale automation across our stack, and ensure our AI medical employees are safe, reliable, and high-performing. You will also recruit and mentor a team, embedding QA into CI/CD pipelines to enable fast, clinical-grade releases.

Key Responsibilities

  • Own QA strategy, defining frameworks for automation, functional, performance, and compliance testing

  • Build and scale Playwright-based test automation for UI and API coverage

  • Ensure reliability by expanding automation coverage, monitoring dashboards, and resolving test failures quickly

  • Guarantee accuracy, security, and compliance (HIPAA/SOC-2), partnering with Engineering and Clinical teams

  • Recruit, mentor, and lead a high-performing QA team

  • Embed QA into CI/CD pipelines using GitHub Actions and related tooling

Hard Requirements

  • Founder / 0β†’1 experience β€” first in function, building QA processes and teams from scratch

  • 6–8+ years in QA with strong expertise in Playwright

  • 3–4+ years of people leadership experience

  • Proven ability to automate functional UI and API test cases

  • Hands-on with QA tools (Playwright, Cypress, PyTest, Postman)

  • Experience scaling test automation and maintaining reliability

  • Highly motivated, driven, and ownership-oriented

Nice-to-Have

  • Experience testing AI/LLM workflows

  • Familiarity with dashboarding and observability tooling

  • GitHub Actions CI/CD integration experience

  • Prior startup or healthcare QA background

First-Month Focus

  • Define Sully.ai’s QA strategy and initial automation framework

  • Implement core Playwright test cases across key workflows

  • Partner with Engineering and Clinical teams to validate compliance needs

Success OKRs (90 Days)

  • Establish automated test coverage across UI and API workflows

  • Integrate QA pipelines into GitHub Actions for reliable CI/CD

  • Deliver measurable improvements in test reliability and release confidence

Culture Fit

  • Persistent, driven problem solver

  • Willing to push back on leadership to defend quality/timelines

  • Thrives in high-ambiguity, fast-paced startup environments

Why Join Sully.ai ?
πŸ”₯ Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
πŸ“ˆ Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
🌎 Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
πŸ’° Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
πŸ† Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.Β 

Other jobs at Sully.ai

fulltimeSanta Clara, CA, US / Remote (San Francisco, CA, US; US)$120K - $150K6+ years

fulltimeUS - Remote / Remote (US)

fulltimeUS - Remote / Remote (US)Full stack

fulltimeMountain View, CA, US / Remote (San Francisco, CA, US; Santa Clara, CA, US; Sunnyvale, CA, US; Palo Alto, CA, US; Oakland, CA, US; San Jose, CA, US; Seattle, WA, US; Los Angeles, CA, US; San Diego, CA, US; Las Vegas, NV, US; Phoenix, AZ, US; OR, US; US)Full stack$150K - $300K3+ years

fulltimeUS - Remote / Remote (US)

fulltimeUS - Remote / Remote (US)Full stack

fulltimeUS - Remote / Remote (US)

fulltimeUS - Remote / Remote (US)Full stack

fulltimeUS - Remote / Remote (US)

fulltimeMountain View, CA, US / Remote (US)Full stack$200K - $230K6+ years

Hundreds of YC startups are hiring on Work at a Startup.

Sign up to see more β€Ί