LanceDB Logo

LanceDB

Senior System Test Engineer

Posted 27 Days Ago
Remote
Hiring Remotely in United States
180K-250K Annually
Senior level
Remote
Hiring Remotely in United States
180K-250K Annually
Senior level
Own system-level testing for Lance and LanceDB across correctness, reliability, scalability, performance, data integrity, fault recovery, upgrades, and compatibility. Build automated test frameworks, realistic workloads, fault-injection scenarios, performance and soak tests, and reproducible CI environments. Investigate failures using logs, metrics, traces, and source code, create minimal reproductions, and partner with engineers on fixes. Apply AI tools responsibly to accelerate test development, failure analysis, and debugging.
The summary above was generated by AI
About LanceDB

AI advances at the speed of its research, and research moves at the speed of its data. LanceDB is the AI-native Multimodal Lakehouse: one system where a researcher curates petabytes of video, audio, and every signal derived from them with a few lines of Python, and the next training run starts as fast as the next idea. Customers like Runway, Midjourney, and Netflix build the future of AI on LanceDB, from frontier and world models to robots and autonomous vehicles.

About the Role

As the Senior System Test Engineer at LanceDB, you will drive the correctness, reliability, and performance of Lance and LanceDB under demanding production conditions. You'll work at the intersection of distributed databases, systems engineering, and test infrastructure, building the frameworks and workloads that expose failures before our users encounter them.

You'll partner closely with engineering to turn architectural risks and real customer workloads into automated, reproducible tests, and to diagnose and fix complex failures. This is a hands-on role with ownership of system-level test strategy and execution, where you'll use AI tooling adeptly to accelerate development and investigation while maintaining rigorous validation.

This is an opportunity to define the quality bar for infrastructure powering the next generation of AI workloads, and to directly influence product architecture, release confidence, and the reliability our users depend on as they move from experimentation to production at scale.

What You'll Do
  • System test strategy: Define and drive system-level testing across correctness, reliability, scalability, and performance, prioritizing the highest-risk behaviors in the platform.

  • Test frameworks and workloads: Build automated test frameworks and realistic workloads covering ingestion, concurrent reads and writes, indexing, querying, and dataset maintenance.

  • Data integrity and fault injection: Validate data integrity and documented consistency guarantees under concurrency, retries, partial failures, and recovery. Develop fault-injection and resilience tests for process crashes, network disruptions, storage errors, resource exhaustion, and interrupted operations.

  • Performance testing: Design load, stress, and long-running soak tests, and identify regressions in latency, throughput, resource usage, and search quality.

  • Upgrades and compatibility: Test upgrades, compatibility, and recovery scenarios to ensure the platform behaves predictably as software and workloads evolve.

  • Partner closely with engineers to investigate failures using logs, metrics, traces, and source code, reduce complex issues to minimal reproductions, and drive fixes and regression coverage.

  • Develop and continuously improve reproducible test environments, integrating reliable, actionable checks into CI and release workflows.

  • Use AI coding assistants and other AI tools to develop test harnesses, explore failure scenarios, analyze results, and accelerate debugging, independently verifying generated code and conclusions.

What We're Looking For
  • 10+ years of experience in software engineering, system test engineering, or test infrastructure, with substantial experience building or validating distributed databases or large-scale data systems

  • Deep understanding of distributed databases, including consistency models, replication, partitioning, concurrency control, durability, and failure recovery

  • Proven track record of designing tests that verify system invariants and uncover data corruption, race conditions, and failures that emerge only under load or partial outages

  • Strong programming skills in Python and at least one systems language such as Rust, C++, Java, or Go, with the ability to build maintainable test infrastructure and debug product code

  • Hands-on experience with fault injection, performance testing, workload generation, and automated testing in distributed environments

  • Demonstrated ability to use AI tooling adeptly in daily engineering work, including coding assistants and agent-based workflows, with sound judgment about validating outputs

  • Experience with Linux, cloud infrastructure, containers, CI/CD, and observability tools

  • Ability to own ambiguous projects, prioritize risk, communicate findings clearly, and collaborate closely with engineers to drive issues to resolution

Nice to Have
  • Experience testing database storage engines, query engines, vector search, or cloud object storage integrations

  • Familiarity with LanceDB, Lance, Apache Arrow, DataFusion, Parquet, or related data infrastructure

  • Experience with property-based testing, fuzzing, differential testing, or distributed consistency testing

  • Experience with Kubernetes, infrastructure as code, and large-scale test environment orchestration

  • Contributions to open-source databases, distributed systems, or testing frameworks

Similar Jobs

An Hour Ago
Easy Apply
Remote or Hybrid
Easy Apply
79K-103K Annually
Mid level
79K-103K Annually
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage end-to-end implementation and adoption of Samsara’s IoT solutions for mid-market customers. Responsibilities include creating launch plans, tracking implementation progress and account health, delivering product training, demonstrating technology, resolving challenges, and coordinating with Sales, Support, Sales Engineering, and Product. The role requires strong customer communication, consultative implementation skills, technical product experience, stakeholder management, and fluency in English and French.
Top Skills: Equipment MonitoringIotSaaSSamsara Connected Operations CloudVehicle Telematics
3 Hours Ago
In-Office or Remote
Mid level
Mid level
Information Technology • Software • Travel
Build and maintain a mature SaaS platform across Rails backend, JSON APIs, MySQL, and Vue.js frontend. Develop travel features, partner integrations, AI-powered functionality, and document generation; optimize performance, write automated tests, upgrade dependencies, address security issues, investigate production incidents, review code, and document work. The role requires autonomous feature ownership, careful work in a large codebase, and collaboration through Git and pull requests.
Top Skills: Amazon CloudfrontAmazon S3Aws EcsAws LambdaCapybaraDockerFactorybotGitGithub ActionsJavaScriptJson ApisMySQLRspecRubyRuby On RailsSentryVueVuetify
Yesterday
Remote
109K-225K Annually
Senior level
109K-225K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex, cross-functional technology programs and projects from initiation through delivery. Establishes governance, delivery plans, milestones, dependencies, risk frameworks, and stakeholder cadences. Partners with Product and Engineering leadership to translate strategic roadmaps into executable release plans, manages critical-path issues and escalations, and drives release readiness across multiple teams. The role also improves program execution, release governance, transparency, quality, and delivery velocity in a healthcare technology environment.
Top Skills: AgileAha!Hybrid Delivery ModelsJIRASoftware Development Lifecycle (Sdlc)

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account