The Senior Software Development Engineer in Test will focus on testing AI systems, developing automated test frameworks, and collaborating with agile teams to ensure software quality.
As a Senior Software Development Engineer in Test, you will be responsible for ensuring the quality and reliability of our AI-powered chatbot systems and email drafting tools. You will design and execute both manual and automated tests, identify bugs, and collaborate closely with developers, product owners, and data scientists to deliver exceptional user experiences.
The candidate MUST demonstrate real depth in at least ONE of the following areas:
A) Deep AI/Chatbot testing
B) Automation ownership (frameworks from scratch, design/architecture, not just implementation).
Location: Only LATAM 100% remote. Working hours are based on the US Central or Eastern Time Zone. With at least 6 hours of overlap.
*Opening not available for the US or Europe.
About Us:
Abstra is a fast-growing, Nearshore Tech Talent services company, providing top Latin American tech talent to U.S. companies and beyond. Founded by U.S.-bred engineers with over 15 years of experience, Abstra specializes in sourcing skilled professionals across a wide range of technologies to meet our clients’ needs, driving innovation and efficiency.
Job Description:
Key Responsibilities:
- Design, develop, and execute manual and automated end-to-end test cases for conversational AI systems and generative email tools.
- Validate natural language processing (NLP) outputs for accuracy, tone, and contextual relevance.
- Build and maintain automated test frameworks for regression, integration, and performance testing.
- Collaborate with cross-functional agile teams to define test strategies, acceptance criteria, and quality benchmarks.
- Identify, document, and track bugs and inconsistencies in Azure DevOps Services and collaborate with the development team to prioritize and resolve issues.
- Perform exploratory testing to uncover edge cases and usability issues.
- Monitor and analyse test results and provide actionable feedback to the development team for rapid iteration and improvement.
- Create and maintain test documentation, including test cases, scripts, and reports.
- Work in an agile development environment, collaborating with the team to deliver quality software iteratively
- Contribute to the continuous improvement of QA processes and best practices.
- Responsible for protecting, securing, and properly handling all confidential data held by Ascensus to ensure against unauthorized access, improper transmission, and/or unapproved disclosure of information that could result in harm to Ascensus or our clients.
- The I-Client philosophy and the Core Values of People Matter, Quality First, and Integrity Always® should be visible in your actions on a day-to-day basis, showing your support of our organizational culture.
Requirements:
- At least 8 years of experience as a Software Engineer, a Software Engineer in Test, a Test Automation Engineer, or equivalent roles with a testing mindset.
- Experience testing AI/ML-based applications, especially chatbots or generative tools (mandatory).
- Experience with LLM-based systems (e.g., GPT, Claude, Gemini).
- Knowledge of prompt engineering and evaluation techniques.
- Passion for AI and a keen eye for user experience and conversational quality.
- Familiarity with A/B testing, telemetry, and user feedback analysis.
- Strong experience developing test frameworks with tools such as Playwright, Selenium, Cucumber, or Leapwork (mandatory).
- Familiarity with writing automation scripts with at least one object-oriented programming language, such as C# or Java.
- Strong experience with a scripting language such as Python, PowerShell, Perl, JavaScript.
- Strong experience working with Database testing techniques using Postgres, Sybase, SQL Server, or Oracle with a strong understanding of database schemas.
- Experience working with performance Engineers or Performance tools such as BlazeMeter, JMeter, and/or Taurus.
- Experience with testing REST API frameworks.
- Excellent verbal and written communication skills.
- Experience working in a fast-paced Agile or SCRUM development methodology.
What We Offer:
- Opportunities for professional growth and development.
- A collaborative and inclusive work environment.
- The chance to work on impactful projects with a talented team.
- Excellent compensation in USD.
- Hardware and software setup (mandatory)
Similar Jobs
Beauty • Robotics • Design • Appliances • Manufacturing
Manage product development projects, ensuring success across scope, cost, and schedule. Lead cross-functional teams and mitigate risks to meet product KPIs.
Top Skills:
ExcelJIRAMs ProjectVisio
Beauty • Robotics • Design • Appliances • Manufacturing
The Senior Medical Device Compliance Engineer ensures compliance with regulatory requirements for medical devices, overseeing design control and post-market processes while collaborating with various teams.
Top Skills:
Iso 14971
Beauty • Robotics • Design • Appliances • Manufacturing
The Product Developer owns the NPD process for Shark and Ninja brands, driving cross-functional collaboration to ensure timely market delivery and high sales while managing project risks and resources.
Top Skills:
ExcelMs ProjectPowerPointVisio
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
