Sustainment Logo

Sustainment

Senior QA Automation Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Austin, TX, USA
Senior level
In-Office
Austin, TX, USA
Senior level
Leads hands-on QA automation for UI and API testing, driving migration from manual coverage to a comprehensive Playwright suite integrated with CI/CD. Performs exploratory testing, establishes quality metrics and QA standards, mentors two QA engineers, and supports daily releases. Also evaluates GenAI and LLM-powered features through evaluation harnesses, ground-truth datasets, and scoring methods.
The summary above was generated by AI

Company Overview: Sustainment is an AI-native software platform that helps US-based manufacturers easily find and work with the critical suppliers they need to build and manage their supply chains. Our vision is to reimagine American manufacturing as a hyperconnected, secure, and resilient ecosystem of local and regional suppliers who can more easily connect, interact, and do business with the industry and government customers that rely on them. We are a dual-use technology platform that supports both DoD and commercial customers in pursuit of our vision.

CLEARANCE REQUIREMENT: Candidates must be eligible to obtain and maintain a U.S. Secret or Top Secret security clearance. This is a non-negotiable, hard requirement driven by our Department of War contractor obligations. Candidates who are not eligible will not be considered for this role.

Job Overview: 

Sustainment builds B2B SaaS for manufacturing supply chains, serving both commercial customers and federal/defense programs. As we move to a daily release cadence, we need a senior, hands-on QA automation engineer to lead the charge toward a fully automated playwright test suite while keeping our releases fast and trustworthy.

This is a player-coach role - roughly 80% hands-on, 20% leadership. You'll spend most of your time testing and building automation, with a light leadership layer: mentoring a small QA team and owning our QA process. It is a testing-and-automation role first, and a leadership role second.

What you'll do

Quality & automation (your core work)

  • Drive the shift from mostly-manual testing to a comprehensive, fully automated playwright test suite. This is the north star of the role.
  • Build, maintain, and scale automated tests (UI and API) and integrate them into our CI/CD pipeline so verification keeps pace with a daily release cadence.
  • Contribute to manual and exploratory testing whenever it's needed, especially on releases and wherever automated coverage doesn't exist yet. You're willing to get in the trenches, not just architect from above.
  • Stand up QA quality instrumentation (e.g., escaped-defect tracking) so we can measure the quality of what we ship, not just the speed.
  • Champion AI-assisted testing as we scale toward AI-native development.

Team leadership (~10–20% of your time)

  • Mentor two QA engineers and raise the team's automation capability.
  • Own and standardize QA process and standards; test plans, entry/exit criteria, a clear bounce-back vs. hold guideline, and QA's definition of done.
  • Act as the QA operational lead and a trusted second to the Director of Engineering, so day-to-day QA runs without needing to route everything through leadership.
Qualifications
  • Senior-level experience in QA and test automation (6+ years).
  • Deep hands-on skill with modern test-automation frameworks (Playwright preferred, Cypress, or similar) and API testing.
  • Experience integrating automated tests into CI/CD pipelines (GitLab a plus).
  • A track record of building an automated suite up from partial or manual coverage.
  • Genuinely comfortable staying hands-on. You want to test and build, not step out of the tools.
  • Some experience mentoring engineers or owning QA processes for a small team.
  • Comfort with Jira for test and defect management.
Nice to have
  • Experience with AI-assisted testing tools and workflows.
  • Delivery into regulated/federal environments (FedRAMP, CUI, DoD); we ship into government spaces.
  • B2B SaaS and/or manufacturing / supply-chain domain experience.
  • Exposure to data or analytics testing.
  • Experience testing agentic / multi-agent systems and prompt-driven workflows.
  • AI-assisted test generation - using LLMs or agents to write and maintain tests (exactly where we're taking QA).
  • ML / data-quality testing - model-output validation, extraction/classification accuracy metrics.

Testing and evaluating GenAI / LLM-powered features; building evaluation harnesses, ground-truth datasets, and scoring for non-deterministic model outputs (accuracy, precision/recall, LLM-as-judge).

What this role is and isn't
  • It is: a senior, hands-on automation engineer who tests daily, builds and owns our automation, and provides lightweight leadership and mentorship for a small team.
  • It isn't: a pure people-management seat. You'll set standards and mentor, but daily testing and automation are the heart of the job. If your goal is to move out of hands-on work into full-time management, this isn't the right fit and that's okay.
Team & context

You'll join a small, high-trust QA team (two engineers today) inside engineering, reporting to the Director of Engineering. We're moving from biweekly to daily releases, we build for both commercial and regulated federal customers, and we're actively adopting AI-assisted development and testing. It's a place to build the QA function into something modern, automated, and measured with real ownership from day one.

Sustainment offers a competitive benefits package for full time employees including medical, dental, vision, paid time off, company holidays, and 401K matching.

Sustainment is proud to be an equal opportunity employer. We provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, veteran status, or any other protected class.

Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

Sustainment participates in E-Verify.

HQ

Sustainment Austin, Texas, USA Office

Austin, TX, United States

Similar Jobs

2 Days Ago
In-Office
90K-110K Annually
Senior level
90K-110K Annually
Senior level
Software • Pharmaceutical
Lead design, development, and maintenance of test automation frameworks; mentor junior engineers; integrate automated tests into CI/CD; perform API and load testing; troubleshoot test failures; implement test data management and collaborate with cross-functional teams to improve QA processes.
Top Skills: Api TestingAzureC#Ci/CdCypressGatlingGitJmeterK6Node.jsPlaywrightPythonRedsailRobot Framework
10 Days Ago
In-Office or Remote
United States
38K-135K Annually
Senior level
38K-135K Annually
Senior level
Agency • Information Technology
Lead QA automation efforts for enterprise applications by defining QA strategy, designing Java/Selenium/Cucumber automation frameworks, integrating tests into CI/CD pipelines on AWS, mentoring QA engineers, managing defect lifecycle, and collaborating with development and DevOps to ensure comprehensive functional, regression, API, and end-to-end testing.
Top Skills: AWSAzure DevopsBambooCucumberDockerGithub ActionsGitlab Ci/CdJavaJenkinsKubernetesSelenium
18 Days Ago
In-Office
Expert/Leader
Expert/Leader
Retail
Lead and scale a QA automation team for store technology systems. Define and implement test automation strategies and frameworks, oversee UI/API/performance testing, integrate automation into CI/CD, maintain QA lab, drive TDD/BDD adoption, coordinate end-to-end testing across teams, mentor engineers, and continuously improve QA processes.
Top Skills: Aws CloudwatchAws LambdaAws Step FunctionsC#CypressJavaJavaScriptJenkinsJmeterKarateMongoDBNode.jsSelenium

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account