Virtasant Logo

Virtasant

Senior Data Engineer, Data Platform

Reposted 21 Days Ago
In-Office or Remote
Hiring Remotely in Austin, TX, USA
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX, USA
Senior level
Design and build scalable data platform services, automation, and integrations. Improve pipeline reliability, observability, schema governance, and developer self-service. Collaborate with data engineering, analytics, and DevOps to deliver APIs, tooling, and production-grade data pipelines.
The summary above was generated by AI
About Virtasant

Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries. We specialize in cloud architecture, infrastructure, migration, and optimization, helping enterprises scale efficiently while maintaining cost control.

Our clients range from Fortune 500 companies to fast-growing startups, relying on us to build high-performance infrastructure, optimize cloud environments, and enable continuous delivery at scale.


About the role

We’re looking for a Senior Data Engineer to join us and work with our client's Data Platform team. Our client is a leading healthcare technology company, dedicated to transforming the patient and provider experience through innovative, data-driven solutions.

You will architect and build core services, automation tools, and integrations that power our client's data ecosystem. You’ll own high-impact platform components, improve pipeline reliability and observability, and partner closely with data engineering, analytics, and DevOps to advance the scalability and developer experience of our client's data platform.


For this role, we can only consider candidates located in contiguous US states.
Also, we are only able to consider candidates who are either US citizens, or Green Card Holders, or sole proprietors of their own LLC company.
We are NOT able to consider candidates on any kind of visa that requires sponsorship, like STEM OPT, H4 EAD, F-1 OPT, L-2S, CPT, etc.
What You’ll Do


  • Build Automation & Tooling: Develop scalable backend services, APIs, and internal tools to automate data platform workflows (e.g., data onboarding, validation, pipeline orchestration, schema tracking, quality monitoring).

  • Data Platform Integration: Integrate tools with core data infrastructure, building pipelines (Airflow, Spark, dbt, Kafka, Snowflake, or similar) to expose capabilities via APIs and UIs.

  • Observability & Governance: Build visualization and monitoring components for data lineage, job health, and quality metrics.

  • Collaboration: Work cross-functionally with data engineering, product, and DevOps teams to define requirements and deliver end-to-end solutions.


What We’re Looking For
  • You have to live in the contiguous United States and have all the necessary documentation to work under an independent contractor agreement. We cannot offer sponsorships or sponsorship transfers, so unfortunately, we CANNOT consider candidates on H1B, OPT, EAD, or CPT visas.

Must-Have Experience
  • 7+ years of experience in data engineering or software development with at least 5 years building production-grade data or platform services

  • Strong programming skills in Python & SQL and at least one major data platform (Snowflake, BigQuery, Redshift, or similar)

  • Develop tooling for schema evolution, data contracts, and developer self-service

  • Deep experience with streaming, distributed compute, or S3-based table formats (Spark, Kafka, Iceberg/Delta/Hudi).

  • Experience with schema governance, metadata systems, and data quality frameworks.

  • Understanding of orchestration tools (Airflow, Dagster, Prefect, etc.)

  • Solid grasp of CI/CD and Docker

  • At least 2 years of experience in AWS

  • Experience with building data pipelines using dbt

Nice-to-haves
  • Experience with data observability, data catalog, or metadata management tools

  • Experience working with healthcare data (X12, FHIR)

  • Proven experience in data migration projects (legacy technologies to the latest technologies)

  • Experience building internal developer platforms or data portals

  • Understanding of authentication/authorization (OAuth2, JWT, SSO)


Our recruitment process

  • Recruiter interview (30 min)

  • Technical Interview (45 min)

  • Screening interview with the client's hiring manager (30 min)

  • Client technical interview (45 min)

We strive to move efficiently from step to step to make the recruitment process as fast as possible.

What we offer

  • Totally remote within the contiguous United States, full-time (40h/week)

  • Stable, long-term independent contract agreement

  • Work hours - US Eastern time office hours

HQ

Virtasant Austin, Texas, USA Office

Austin, Texas, United States

Similar Jobs

3 Days Ago
Easy Apply
Remote
United States
Easy Apply
130K-160K Annually
Senior level
130K-160K Annually
Senior level
Healthtech • Software
Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.
Top Skills: AirflowApache IcebergAPIsAthenaAWSCi/CdDatabricksDbtEmrHipaaKafkaParquetPythonS3SnowflakeSQL
18 Days Ago
Remote
USA
180K-270K Annually
Senior level
180K-270K Annually
Senior level
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Lead operational reliability and platform enablement for Databricks: build monitoring, CI/CD, deployment standards, compute and job policies, observability, runbooks, and governance to support secure, cost-aware, production data workloads across regulated environments. Mentor engineers and align platform with cloud/infrastructure and compliance requirements.
Top Skills: Ci/CdDatabricksDatabricks Asset BundlesDatabricks WorkflowsDelta LakeInfrastructure-As-CodeService PrincipalsUnity CatalogVersion Control (Git)
7 Days Ago
Remote
United States
170K-230K Annually
Senior level
170K-230K Annually
Senior level
Fintech • Information Technology • Software
Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.
Top Skills: AWSAws LambdaColumnar Data StoresDockerEksEmrGCPGoHadoopInfrastructure-As-CodeKafkaKubernetesAzureOpensearchPostgresPythonRdsRedshiftS3SnsSparkSqsVector Db

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account