Virtasant Logo

Virtasant

Senior Data Engineer, Data Platform

Posted 3 Hours Ago
In-Office or Remote
Hiring Remotely in Austin, TX, USA
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX, USA
Senior level
Design and build scalable data platform services, automation, and integrations. Improve pipeline reliability, observability, schema governance, and developer self-service. Collaborate with data engineering, analytics, and DevOps to deliver APIs, tooling, and production-grade data pipelines.
The summary above was generated by AI
About Virtasant

Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries. We specialize in cloud architecture, infrastructure, migration, and optimization, helping enterprises scale efficiently while maintaining cost control.

Our clients range from Fortune 500 companies to fast-growing startups, relying on us to build high-performance infrastructure, optimize cloud environments, and enable continuous delivery at scale.


About the role

We’re looking for a Senior Data Engineer to join us and work with our client's Data Platform team. Our client is a leading healthcare technology company, dedicated to transforming the patient and provider experience through innovative, data-driven solutions.

You will architect and build core services, automation tools, and integrations that power our client's data ecosystem. You’ll own high-impact platform components, improve pipeline reliability and observability, and partner closely with data engineering, analytics, and DevOps to advance the scalability and developer experience of our client's data platform.


For this role, we can only consider candidates located in contiguous US states.
Also, we are only able to consider candidates who are either US citizens, or Green Card Holders, or sole proprietors of their own LLC company.
We are NOT able to consider candidates on any kind of visa that requires sponsorship, like STEM OPT, H4 EAD, F-1 OPT, L-2S, CPT, etc.
What You’ll Do


  • Build Automation & Tooling: Develop scalable backend services, APIs, and internal tools to automate data platform workflows (e.g., data onboarding, validation, pipeline orchestration, schema tracking, quality monitoring).

  • Data Platform Integration: Integrate tools with core data infrastructure, building pipelines (Airflow, Spark, dbt, Kafka, Snowflake, or similar) to expose capabilities via APIs and UIs.

  • Observability & Governance: Build visualization and monitoring components for data lineage, job health, and quality metrics.

  • Collaboration: Work cross-functionally with data engineering, product, and DevOps teams to define requirements and deliver end-to-end solutions.


What We’re Looking For
  • You have to live in the contiguous United States and have all the necessary documentation to work under an independent contractor agreement. We cannot offer sponsorships or sponsorship transfers, so unfortunately, we CANNOT consider candidates on H1B, OPT, EAD, or CPT visas.

Must-Have Experience
  • 7+ years of experience in data engineering or software development with at least 5 years building production-grade data or platform services

  • Strong programming skills in Python & SQL and at least one major data platform (Snowflake, BigQuery, Redshift, or similar)

  • Develop tooling for schema evolution, data contracts, and developer self-service

  • Deep experience with streaming, distributed compute, or S3-based table formats (Spark, Kafka, Iceberg/Delta/Hudi).

  • Experience with schema governance, metadata systems, and data quality frameworks.

  • Understanding of orchestration tools (Airflow, Dagster, Prefect, etc.)

  • Solid grasp of CI/CD and Docker

  • At least 2 years of experience in AWS

  • Experience with building data pipelines using dbt

Nice-to-haves
  • Experience with data observability, data catalog, or metadata management tools

  • Experience working with healthcare data (X12, FHIR)

  • Proven experience in data migration projects (legacy technologies to the latest technologies)

  • Experience building internal developer platforms or data portals

  • Understanding of authentication/authorization (OAuth2, JWT, SSO)


Our recruitment process

  • Recruiter interview (30 min)

  • Technical Interview (45 min)

  • Screening interview with the client's hiring manager (30 min)

  • Client technical interview (45 min)

We strive to move efficiently from step to step to make the recruitment process as fast as possible.

What we offer

  • Totally remote within the contiguous United States, full-time (40h/week)

  • Stable, long-term independent contract agreement

  • Work hours - US Eastern time office hours

HQ

Virtasant Austin, Texas, USA Office

Austin, Texas, United States

Similar Jobs

22 Hours Ago
Remote or Hybrid
United States
150K-230K Annually
Senior level
150K-230K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Design, build, and operate Jellyfish's Databricks Lakehouse and data/AI platform. Build ingestion, transformation, and delivery pipelines; govern data with Unity Catalog; enable BI, agentic analytics, metadata, lineage, and observability. Provide technical leadership, set architecture and standards, mentor peers, and collaborate with cross-functional stakeholders to make Databricks the foundation for analytics and AI.
Top Skills: Ci/CdDatabricksDatabricks AppsDatabricks Asset BundlesDatabricks LakehouseDatabricks SqlDatabricks WorkflowsDbtDelta LakeDelta LakeGenieLlmsOntologyPythonRetrieval-Augmented GenerationSQLTerraformUnity Catalog
4 Days Ago
Remote or Hybrid
USA
170K-170K Annually
Senior level
170K-170K Annually
Senior level
Big Data • Machine Learning • Software • Database • Analytics • Generative AI • Big Data Analytics
Design, build, and optimize scalable batch and streaming data pipelines. Model and process structured and unstructured data, ensure production reliability and observability, apply ML techniques for insight extraction, and drive data strategy while adopting modern tooling and IaC practices.
Top Skills: AirflowAmazon NeptuneAthenaAws BatchAws S3CircleCICo-PilotCodexCursorDatabricksDockerDynamoDBEcsElasticsearchGitGluePandasPysparkPythonRdsSql (Postgresql)Terraform
5 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
131K-220K Annually
Senior level
131K-220K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate scalable, secure data platform infrastructure for ingesting, processing, cataloging, and accessing petabytes of data. Improve Spark/Databricks reliability and developer experience, build ingestion/replication systems, develop internal libraries and tooling (Go/Python), and collaborate with cross-functional teams to support analytics, ML, and customer-facing data products.
Top Skills: AirflowAmundsenSparkAws RdsCloudFormationDagsterDatabricksDatahubDelta LakeDockerDynamoDBEcsFargateGoHive MetastoreHudiIcebergJavaKinesisKubernetesLambdaPrefectPythonS3ScalaSqsTerraformUnity Catalog

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account