Develop and maintain automated UI and API testing for Vena’s agentic AI products. Define functional, integration, performance, exploratory, and regression strategies; validate AI model accuracy, consistency, bias, boundaries, and performance; enhance scalable test frameworks and CI/CD pipelines; troubleshoot automation issues; perform root cause analysis; and collaborate with engineering and product teams to improve quality, reliability, and test coverage.
As a Senior Software Developer in Test, you will be responsible for the development, execution, and maintenance of automated tests to support the Software Test Life Cycle for Vena’s agentic AI solutions. You will collaborate closely with development and product teams to define and execute functional, integration, and regression testing strategies, while continuously improving the scalability, stability, and reliability of testing processes.
You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.
How You'll Make an Impact
- Analyze functional and technical requirements to define comprehensive test strategies and automation needs
- Design, write, maintain, and manage automated UI and API test suites
- Contribute to building and enhancing scalable automation frameworks (e.g., Playwright, Rest-Assured)
- Identify, plan, and execute exploratory, functional, integration, performance, and regression tests
- Collaborate with development and product teams to validate testing requirements and optimize test coverage
- Champion best practices for automation, test data management, CI/CD integration, and code quality
- Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability
- Perform root cause analysis and support teams in identifying and preventing defects
We'd Love to See
- 5+ years’ experience in QA/QE and test automation development roles, within a fast-paced Agile environment
- AI Testing Expertise: Proven track record testing AI/ML products (including prompt evaluation, bias detection, or model boundary testing)
- Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and automatically detect flaky tests.
- Strong understanding of software testing methodologies, automation design patterns, and the fundamentals of high-quality test case development
- 3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest, etc.)
- Hands-on experience with version control, issue tracking, and test case management tools (GitHub, Gitlab, JIRA, Xray, Zephyr, Qase, etc.)
- Proficiency with relational databases and data validation (SQL, MS SQL, Oracle, GraphQL, or DB2)
- Proficiency in one or more programming languages (Java, JavaScript, Typescript, C#, or Python)
- Ability to think critically about system architecture and assess the impact of product changes across components
- Strong troubleshooting, analytical, and problem-solving skills
- Exceptional written and verbal communication skills, with the ability to articulate both technical and non-technical concepts
- Interest in AI and willingness to explore AI-driven solutions to enhance performance and drive efficiencies
The base salary range for this role is $114,750-155,250 CAD.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
About
At Vena, we’re reimagining how businesses plan and grow: powered by data, collaboration, and innovation 🌱 Headquartered in Toronto with a global reach, we help finance teams work smarter using the tools they already love (yes, we’re talking about Excel!). Trusted by over 1,800 organizations and 150,000+ users every day, Vena Solutions brings clarity to complexity. We're a people led company that leads with our CORE values (Customer Trust, One Team, Respect & Authenticity and Execution Excellence) and are driven by our mission We’re growing fast, thinking big, and having fun along the way. The future of finance is being built here, and we’d love for you to be part of it 🚀Why Choose Us:💰 CompensationWe offer competitive and comprehensive total rewards packages that we review yearly to stay ahead of the market! Transparency is key, we keep you in the loop on how we design our comp programs. Build your future with our Employee Stock Option Program, Retirement Savings, Support & 401k Matching Programs.🎓 Personal Growth & LearningLevel up your skills with Vena! We support your journey with education subsidies, professional development programs, and learning opportunities to help you grow your career and reach your goals. Your future is bright and we’re here to invest in it!🧘♀️ Health & WellnessYour well-being = our priority! Great health & dental plans, wellness sessions (virtual & in-person), Employee Assistance Program (EAP), and a free Headspace subscription to support your mental health.🌍 Global ReachVena is everywhere you are! With offices in Toronto, London, and Indore, as well as team members across the United States, EMEA and beyond, we're a truly global company. Collaborate with colleagues around the world and bring diverse ideas to life: no passport required!🌴 Time OffRecharge with generous leave options - perfect for vacation, wellness, personal time, parental support, volunteering, and more.🏡 FlexibilityWe embrace a flexible culture that supports different ways of working, depending on the role and location. While some of our teams enjoy hybrid arrangements, others thrive in-office or remotely. With modern workspaces in Toronto, Indore, and London, we offer inspiring environments when you need them - and the freedom to work in ways that work best for you and your team.✨ AI-Powered InnovationAt Vena, we don’t just keep up, we're leading the way! 🚀We empower team members at every level to actively explore AI best practices, identify meaningful opportunities to apply AI in their work, and champion innovative solutions that drive impact.By fostering a culture of curiosity, innovation, and responsible use, we’re building a future where AI enhances how we work, think, and lead. From automating workflows to enhancing insights, AI is woven into everything we do.While every hiring decision is made by people, we may use AI to support application review.👉 Check us out:▶️YouTube💼 LinkedIn🔗GlassDoor* Vacancy Disclosure: Unless otherwise stated, all job postings on our careers site are for existing vacancies. Where explicitly stated, certain postings may be for anticipated vacancies that we expect to open in the near future.
Similar Jobs
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Build and maintain GTM data pipelines, marts, semantic models, and dashboards supporting headcount planning, quota attainment, pipeline, and sales effectiveness. Partner with GTM analysts and stakeholders to establish trusted metrics, document data systems, enable self-service analytics, and develop AI-powered natural-language data tools. Translate complex data concepts for executives and engineers while advancing the GTM data roadmap.
Top Skills:
Ai Data ToolingBigQueryDbtGitHexSalesforceSemantic ModelsSnowflakeSQL
Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Lead AI- and data-driven business transformation for North American enterprise customers. Own value realization from discovery through ROI across finance, supply chain, order-to-cash, procure-to-pay, inventory, and related processes. Manage complex transformation programs, executive stakeholders, governance, change management, and strategic roadmaps while using Celonis and AI tools to accelerate technical outputs, automate project management, and drive platform adoption.
Top Skills:
Ai CopilotsCelonis Context ModelCelonis PlatformOracleProcess MiningSalesforceSAPWorkday
Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Lead AI- and data-driven business transformation for North American customers across order-to-cash, procure-to-pay, inventory, and supply chain processes. Own value realization from discovery through ROI, develop executive narratives, manage stakeholders and global transformation workstreams, automate governance and project management with AI tools, and drive Celonis platform adoption. Partner with sales, value engineering, and customer leaders to build strategic roadmaps, enable change, and identify expansion opportunities.
Top Skills:
Ai CopilotsArtificial IntelligenceCelonis Process Intelligence PlatformOracleProcess MiningSalesforceSAPWorkday
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine


