Top Senior Data Engineer Jobs in Austin, TX

Build and configure a government Databricks workspace, develop ingestion pipelines from enterprise systems, and prepare data for reporting. Implement Unity Catalog governance, metadata, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and operating procedures. The role also requires integrating legacy systems, optimizing Delta Lake pipelines, and supporting long-term platform sustainment.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Design, develop, and optimize enterprise-scale data platforms, pipelines, data lakes, warehouses, and analytical datasets on Azure and Snowflake. Build ETL/ELT processes using ADF, Databricks, PySpark, SQL, Python, and Snowflake. Manage data models, governance, security, quality, CI/CD, cloud migrations, and performance optimization. Collaborate with stakeholders, troubleshoot production issues, document solutions, and support Agile delivery.

Designs, builds, and manages cloud-based data systems, including pipelines, data lakes, warehouses, lakehouses, databases, and ETL processes. Develops optimized Python and SQL queries, improves workflow performance, and supports data movement between on-premises and cloud environments. Collaborates with leadership, analysts, research teams, and other departments to define requirements and reporting needs. Applies data governance, access controls, security, compliance, troubleshooting, and system support practices.

Designs and scales cloud-native data platforms and ingestion pipelines using AWS, Databricks, and Spark. Builds APIs, file-upload mechanisms, ETL/ELT workflows, data transformations, and Lakehouse architecture supporting analytics, machine learning, and operational use cases. Provides operational support for legacy C# .NET ingestion processes, troubleshoots pipelines, and promotes data governance, security, reliability, and documentation in a multi-tenant SaaS environment.

Designs and maintains scalable cloud data pipelines, ELT/ETL workflows, data models, and automation systems supporting cloud cost visibility and optimization. Uses Python, SQL, dbt, Airflow, AWS services, and Snowflake to process telemetry and usage data. Responsibilities include query and infrastructure optimization, data quality validation, auditing, troubleshooting, and collaboration with Engineering and Finance stakeholders.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Architects, develops, and maintains enterprise data platforms, scalable ETL/ELT pipelines, distributed processing systems, data lakes, and cloud-native solutions. The role supports analytics, business intelligence, and machine learning initiatives through data modeling, warehousing, streaming, governance, security, and performance optimization. Responsibilities include collaborating with technical and business stakeholders, deploying and operating data platforms across major cloud providers, troubleshooting complex processing issues, and applying DevOps, CI/CD, Agile, and DataOps practices.

Lead the architecture and strategic direction of an enterprise data platform across ingestion, storage, processing, governance, and consumption. Design scalable lakehouse, warehouse, batch, and streaming solutions; establish data modeling, security, governance, lineage, and data product standards; optimize cost, capacity, availability, and disaster recovery; guide architecture reviews; partner with ML, BI, and product teams; and mentor data engineers and architects.

Design, build, and productionize batch and streaming ETL/ELT pipelines and ML workflows on Azure Databricks. Implement Unity Catalog data products, MLflow model lifecycle controls, CI/CD for data/ML artifacts, and operational monitoring. Partner with cross-functional teams to modernize legacy workflows into scalable, production-ready solutions.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Lead the design, development, scaling, and operation of enterprise data platforms, services, and pipelines. Own mission-critical systems, deliver complex multi-team projects, build analytics solutions, and improve data delivery processes. Partner with architects, engineers, analysts, data scientists, and business stakeholders to create reliable, observable, secure, and governed platforms. Provide technical leadership, evaluate technologies, establish engineering best practices, mentor engineers, and guide technical decisions across teams.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Design, build, and maintain scalable ETL/ELT pipelines and data warehouse architecture. Partner with cross-functional teams to define KPIs, ensure data quality and governance, own billing data infrastructure, and deliver dashboards and analytics for leadership while mentoring peers.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Design, build, and operate scalable real-time and batch data pipelines ingesting high-frequency telemetry, simulation, and trackside data. Own Kafka/Flink streaming components, Databricks lakehouse implementations, and infrastructure-as-code deployments. Develop software in Python/Java/SQL, integrate systems, automate testing and releases, performance-tune pipelines, and mentor peers to ensure resilient, secure, high-performance data delivery for motorsports teams.

Design, build, and maintain scalable data pipelines and cloud data infrastructure (warehouse, RBAC, validation). Collaborate with data scientists and engineers, orchestrate ML pipelines, ensure data quality/security, optimize cost and performance, lead incident response and mentor teammates.