Develop and maintain automated UI and API testing for Vena’s agentic AI products. Define functional, integration, performance, exploratory, and regression strategies; validate AI model accuracy, consistency, bias, boundaries, and performance; enhance scalable test frameworks and CI/CD pipelines; troubleshoot automation issues; perform root cause analysis; and collaborate with engineering and product teams to improve quality, reliability, and test coverage.
As a Senior Software Developer in Test, you will be responsible for the development, execution, and maintenance of automated tests to support the Software Test Life Cycle for Vena’s agentic AI solutions. You will collaborate closely with development and product teams to define and execute functional, integration, and regression testing strategies, while continuously improving the scalability, stability, and reliability of testing processes.
You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.
How You'll Make an Impact
- Analyze functional and technical requirements to define comprehensive test strategies and automation needs
- Design, write, maintain, and manage automated UI and API test suites
- Contribute to building and enhancing scalable automation frameworks (e.g., Playwright, Rest-Assured)
- Identify, plan, and execute exploratory, functional, integration, performance, and regression tests
- Collaborate with development and product teams to validate testing requirements and optimize test coverage
- Champion best practices for automation, test data management, CI/CD integration, and code quality
- Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability
- Perform root cause analysis and support teams in identifying and preventing defects
We'd Love to See
- 5+ years’ experience in QA/QE and test automation development roles, within a fast-paced Agile environment
- AI Testing Expertise: Proven track record testing AI/ML products (including prompt evaluation, bias detection, or model boundary testing)
- Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and automatically detect flaky tests.
- Strong understanding of software testing methodologies, automation design patterns, and the fundamentals of high-quality test case development
- 3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest, etc.)
- Hands-on experience with version control, issue tracking, and test case management tools (GitHub, Gitlab, JIRA, Xray, Zephyr, Qase, etc.)
- Proficiency with relational databases and data validation (SQL, MS SQL, Oracle, GraphQL, or DB2)
- Proficiency in one or more programming languages (Java, JavaScript, Typescript, C#, or Python)
- Ability to think critically about system architecture and assess the impact of product changes across components
- Strong troubleshooting, analytical, and problem-solving skills
- Exceptional written and verbal communication skills, with the ability to articulate both technical and non-technical concepts
- Interest in AI and willingness to explore AI-driven solutions to enhance performance and drive efficiencies
The base salary range for this role is $114,750-155,250 CAD.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
About
At Vena, we’re reimagining how businesses plan and grow: powered by data, collaboration, and innovation 🌱 Headquartered in Toronto with a global reach, we help finance teams work smarter using the tools they already love (yes, we’re talking about Excel!). Trusted by over 1,800 organizations and 150,000+ users every day, Vena Solutions brings clarity to complexity. We're a people led company that leads with our CORE values (Customer Trust, One Team, Respect & Authenticity and Execution Excellence) and are driven by our mission We’re growing fast, thinking big, and having fun along the way. The future of finance is being built here, and we’d love for you to be part of it 🚀Why Choose Us:💰 CompensationWe offer competitive and comprehensive total rewards packages that we review yearly to stay ahead of the market! Transparency is key, we keep you in the loop on how we design our comp programs. Build your future with our Employee Stock Option Program, Retirement Savings, Support & 401k Matching Programs.🎓 Personal Growth & LearningLevel up your skills with Vena! We support your journey with education subsidies, professional development programs, and learning opportunities to help you grow your career and reach your goals. Your future is bright and we’re here to invest in it!🧘♀️ Health & WellnessYour well-being = our priority! Great health & dental plans, wellness sessions (virtual & in-person), Employee Assistance Program (EAP), and a free Headspace subscription to support your mental health.🌍 Global ReachVena is everywhere you are! With offices in Toronto, London, and Indore, as well as team members across the United States, EMEA and beyond, we're a truly global company. Collaborate with colleagues around the world and bring diverse ideas to life: no passport required!🌴 Time OffRecharge with generous leave options - perfect for vacation, wellness, personal time, parental support, volunteering, and more.🏡 FlexibilityWe embrace a flexible culture that supports different ways of working, depending on the role and location. While some of our teams enjoy hybrid arrangements, others thrive in-office or remotely. With modern workspaces in Toronto, Indore, and London, we offer inspiring environments when you need them - and the freedom to work in ways that work best for you and your team.✨ AI-Powered InnovationAt Vena, we don’t just keep up, we're leading the way! 🚀We empower team members at every level to actively explore AI best practices, identify meaningful opportunities to apply AI in their work, and champion innovative solutions that drive impact.By fostering a culture of curiosity, innovation, and responsible use, we’re building a future where AI enhances how we work, think, and lead. From automating workflows to enhancing insights, AI is woven into everything we do.While every hiring decision is made by people, we may use AI to support application review.👉 Check us out:▶️YouTube💼 LinkedIn🔗GlassDoor* Vacancy Disclosure: Unless otherwise stated, all job postings on our careers site are for existing vacancies. Where explicitly stated, certain postings may be for anticipated vacancies that we expect to open in the near future.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Generate and qualify enterprise sales opportunities for Samsara’s IoT and connected operations platform. Responsibilities include researching and mapping accounts, prospecting, making approximately 50 cold calls daily, building demand, engaging executives, learning customer operations, and collaborating with teammates. The role offers a path toward closing sales positions and requires resilience, curiosity, and a growth mindset.
Top Skills:
Artificial Intelligence (Ai)Internet Of Things (Iot)Linkedin Sales NavigatorSaaSSalesforceZoominfo
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Onboard and activate Square sellers by leading scoping calls, delivering tailored training, tracking milestones, resolving blockers, and ensuring timely go-live. Manage 20–30 concurrent onboarding engagements while maintaining product expertise, communicating proactively, escalating complex issues, and contributing to process improvements. Collaborate with sales, account management, product, and marketing teams, use AI to improve workflows, and support sellers across POS, online, and integration products.
Top Skills:
Ai Tools And PlatformsLookerPos SystemsSalesforceSquare
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Serve as the primary post-implementation contact for top customers, craft joint success plans, run executive business reviews and workshops, mentor teammates, support French-speaking customers, and advise on customizing Samsara’s IoT platform to drive safety, efficiency, and sustainability.
Top Skills:
IotSamsara PlatformVehicle TelematicsVideo-Based Safety
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
