Kiddom
Senior QA Engineer, AI Experience
Similar Jobs
Agency • Information Technology
Lead QA Automation for agentic AI products by designing eval pipelines, golden datasets, and automated tests for tool-use, hallucination detection, latency/token monitoring, and regression across models and prompts. Integrate performance testing into CI/CD and collaborate with AI engineers to convert requirements into measurable automated evaluations.
Top Skills:
Ci/CdClaude 3.5CypressDeepevalGpt-4JSONLangsmithPlaywrightPromptfooPytestPythonRagRagasSeleniumSQL
.png)
Healthtech • Pharmaceutical • Telehealth
Build data and semantic models, documentation, context, and evaluations that improve conversational analytics powered by LLMs. Embed with stakeholder teams to understand analyst workflows and business needs, then develop self-service tooling and standardized analytic frameworks. Train non-data stakeholders on effective data and LLM usage, create reusable training materials, maintain evaluation processes, and track conversational analytics accuracy. Requires strong SQL, dbt modeling, BI, communication, teaching, problem-solving, and project ownership skills.
Top Skills:
Data PipelinesDbtHexLlmsLookerSQL
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage enterprise customer implementations of Samsara’s IoT platform, from deployment and launch planning through adoption and account health tracking. Build trusted relationships with executives and users, provide tailored training, explain technical capabilities, and coordinate with Sales, Support, Sales Engineering, and Product. The role requires strong consultative communication, organization, technical-product understanding, and the ability to manage multiple customer engagements in a remote environment.
Top Skills:
Internet Of Things (Iot)SaaSSamsara Connected Operations CloudVehicle Telematics
About Kiddom
Kiddom is a groundbreaking educational platform that promotes student equity and growth by uniting high-quality instructional materials with dynamic digital learning. Through unparalleled curriculum management functionality, Kiddom empowers schools and districts to take ownership of their curriculum – resulting in learning experiences tailored to meet the unique needs and goals of local communities. Kiddom’s high-quality curriculum is layered with robust teacher and leader data insights to drive the continuous improvement of instructional decisions, school/district programming, and professional learning.
As a Senior QA Engineer, you will play an important role in ensuring the quality and reliability of our educational platforms. You will work at the intersection of traditional quality assurance and cutting-edge AI technology, contributing to our testing infrastructure and improving learning outcomes for our users. You are expected to exemplify company values and possess the capabilities to keep the team on track through independent project management and process adherence.
What You'll Do...
- Project Leadership: Keep team projects on track, demonstrating strong ownership and initiative, while effectively managing interactions with cross-functional partner groups.
- Technical Estimation & Strategy: Independently and accurately estimate the QA level of effort (costing) for projects, considering maintenance, timelines, and business pressures.
- Requirement Analysis & Design Feedback: Deeply understand and analyze user stories, product specifications, and requirements to ensure testability. Provide critical feedback on functional issues, acceptance criteria, and design flaws early in the development lifecycle.
- Testing & Debugging: Design and execute comprehensive tests, and debug complex issues, in possibly unfamiliar areas of the application.
- AI Tooling: Proactively integrate AI tools into your QA workflows to improve efficiency and accuracy, while evaluating and recommending specific testing tools (e.g., self-healing scripts, AI-driven test generation) to increase team velocity.
- Testing AI Features: Validate AI-driven educational features, such as personalized learning paths or automated grading systems, ensuring accuracy and bias mitigation.
- Automation & Code Quality: Create complex test scripts, and conduct high-quality code reviews for automated scripts with actionable feedback.
- Documentation: Develop thorough test plans that prioritize maintainability and address immediate business needs. Utilize LLMs to generate test data, summarize bug reports, and create initial drafts of test documentation.
- Defect Management: Conduct in-depth defect analysis to identify root causes and trends, improving overall product quality.
- Support: support customers by triaging user-reported issues.
What we're looking for...
- 5+ years of professional experience in functional manual testing.
- Expert Knowledge: Expert understanding of core QA concepts, testing strategies, and the software test cycle process.
- Automation Proficiency: Deep experience with functional automation tools (Playwright, Selenium, and JUnit, etc.)
- AI Tooling: Proven ability to use AI tools for test automation, bug triage, and test data generation to streamline repetitive tasks.
- Communication & Influence: Excellent verbal and written communication skills with a track record of contributing materially outside of individual work to assist the wider team.
- Debugging Skills: Strong ability to solve technical issues in both familiar and unfamiliar functionality.
- Work Style: Excellent attention to detail, high accountability, and the ability to handle problems from start to finish with an appropriate response.
Salary range is dependent on geographic location, prior experience, seniority, and demonstrated role related ability during the interview process.
What we offer
Full time permanent employees are eligible for the following benefits from their first day of employment:
* Competitive salary
* Meaningful equity
* Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
* One Medical membership (in participating locations)
* Flexible vacation time policy (subject to internal approval). Average use 4 weeks off per year.
* 10 paid sick days per year (pro rated depending on start date)
* Paid holidays
* Paid bereavement leave
* Paid family leave after birth/adoption. Minimum of 16 paid weeks for birthing parents, 10 weeks for caretaker parents. Meant to supplement benefits offered by State.
* Commuter and FSA plans
Equal Employment Opportunity Policy
Kiddom is committed to providing equal employment opportunities to all employees and applicants without regard to race, religion, color, gender, sexual orientation, transgender status, national origin, citizenship status, uniform service member status, pregnancy, age, genetic information, disability, or any other protected status in accordance with all applicable federal, state, and local laws.
Kiddom San Francisco, California, USA Office
We are in Union Square, close to BART, MUNI, other public transportation, coffee shops, restaurants, bars, and shops. It's a bustling neighborhood in the heart of San Francisco with easy access to restaurants for offsite socializing at lunch or after work.
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
