FriendliAI Logo

FriendliAI

QA Engineer

Posted 2 Days Ago
Be an Early Applicant
Hybrid
San Francisco, CA, USA
Mid level
Hybrid
San Francisco, CA, USA
Mid level
Own quality for FriendliAI's full SaaS stack, including backend microservices, frontend, model deployments, and inference. Build pytest automated suites, Locust performance tests, Playwright end-to-end tests, and design strategies for validating LLM inference and model deployment workflows.
The summary above was generated by AI
About the Job

Friendli Suite is our SaaS platform that includes microservices, a frontend, multi-cloud infrastructure, enterprise authentication, billing, and organization management. However, what makes this role unique is that our platform delivers AI inference. Validating whether inference works well is a problem that traditional QA methods do not fully solve. A deployment can succeed technically and still produce poor inference.

We are looking for a dedicated QA engineer who can own the product's quality, ensuring our product works the way any well-run SaaS platform should, while also developing the approaches needed to validate AI inference quality, model deployments, and integrations that traditional testing alone cannot cover.

Key Responsibilities
  • Own quality across FriendliAI's full platform stack: backend microservices, frontend, model deployments, and inference pipelines.

  • Build and maintain automated test suites using pytest, covering unit, integration, and regression testing across backend services.

  • Develop and run load and scalability tests using Locust to validate platform performance under real-world conditions.

  • Own frontend and end-to-end testing with Playwright across the full user-facing product.

  • Design and implement test strategies that account for LLM inference.

  • Work closely with infrastructure and backend engineers to validate model deployment workflows, multi-cloud orchestration, and service integrations.

  • Identify coverage gaps, prioritize test investment, and build tooling and pipelines.

Qualifications
  • 3+ years of experience in software quality engineering, with a track record of owning test strategy.

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent.

  • Proficiency in Python and hands-on experience with pytest for test automation.

  • Experience with load and performance testing tools such as Locust.

  • Experience with browser automation and end-to-end testing frameworks such as Playwright.

  • Working knowledge of LLM serving.

  • Strong experience testing distributed systems with multiple interconnected components.

  • Strong systems thinking.

  • Comfortable working in a fast-moving environment.

Preferred Experience
  • Familiarity with AI infrastructure or model serving systems

  • Experience building QA infrastructure from scratch in an early-stage or scaling environment.

  • Background in performance and scalability testing for cloud-native or multi-cloud systems.

  • Experience covering both backend and frontend testing in a single role.

  • Exposure to observability tooling and how it supports debugging and quality validation.

Benefits
  • Flexible working hours

  • Daily lunch and dinner provided; unlimited snacks and beverages

  • Supportive and highly collaborative work environment

  • Health check-up support and top-tier equipment/hardware support

  • A front-row seat to the generative AI infrastructure revolution

  • Competitive compensation, startup equity, health insurance, and other benefits.

About FriendliAI

FriendliAI is building the world’s best AI inference platform that makes large language and multi-modal models fast, efficient, and deployable at scale. We power high-throughput, low-latency AI workloads for organizations worldwide and integrate directly with Hugging Face, giving developers instant access to over 500,000 open-source models.

We are a small, fast-moving team doing work that matters at one of the most exciting moments in the history of technology. With our world-class inference engine, we are building a platform that the AI industry can actually rely on.

Similar Jobs

3 Days Ago
In-Office
100K-120K Annually
Mid level
100K-120K Annually
Mid level
Healthtech • Logistics • Pharmaceutical
Hands-on firmware QA role validating IoT cold-chain devices on real hardware. Execute manual regression and ship testing, reproduce and triage device issues using logs and lab tools, validate GPS and connectivity behavior, run smoke/regression test passes, and create light scripting/tooling to accelerate tests. Collaborate with firmware, hardware, backend, and operations to ensure release readiness and communicate quality status and risks to stakeholders.
Top Skills: Bash/ShellEmbedded FirmwareGps ModulesIotOta UpdatesPythonSerial (Uart) Logs
3 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
Logistics • Professional Services • Transportation • Industrial
Design, develop, and execute automated tests, perform API and performance testing, identify and document defects, collaborate with cross-functional teams to ensure product quality and resolve issues.
Top Skills: Api TestingPerformance TestingTest Automation
4 Days Ago
In-Office
Sunnyvale, CA, USA
123K-135K Annually
Senior level
123K-135K Annually
Senior level
Cloud • Software
Design, develop, and execute functional and performance test plans and cases for VoIP, networking, mobile and application-based solutions. Build and maintain test labs, use automation and AI-assisted testing tools, track and drive defect resolution, report quality metrics, and collaborate with cross-functional teams to improve coverage and efficiency.
Top Skills: Ai-Assisted TestingAndroidDatabase AdministrationGenerative AiiOSLinuxNetworkingTest AutomationVoip

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account