Design, build, and optimize scalable cloud data pipelines and infrastructure. Maintain and refactor SQL and ETL processes, automate data workflows, ensure data quality/security, and troubleshoot complex issues. Provide technical leadership and mentor junior engineers while collaborating with stakeholders to translate requirements.
Summary:
The Senior Data Engineer designs, builds, and optimizes scalable data pipelines and cloud-based data infrastructure. This role is critical to managing and organizing structured and unstructured data across the organization to enable outcomes analysis, insights, compliance, reporting, business intelligence, and data science. The Senior Engineer ensures data quality, security, and performance across platforms while providing technical leadership and mentorship to junior engineers.
Essential Duties & Responsibilities:
- Design and build efficient, scalable data pipelines using cloud services
- Maintain and refactor complex SQL and ETL processes in enterprise data platforms
- Develop automation scripts, APIs, and infrastructure components
- Collaborate with architects, analysts, and stakeholders to translate requirements
- Ensure strong data quality, integrity, and security controls across platforms
- Troubleshoot complex data issues and lead root cause analysis
Skills & Competencies:
- Advanced SQL and strong data modeling expertise
- Proficiency in Python or JVM languages for data engineering and automation
- Deep knowledge of cloud-based data patterns, distributed systems, and modern data architectures
- Strong analytical reasoning and problem-solving abilities
- Ability to lead delivery efforts and mentor junior team members
- Clear communication skills with the ability to explain technical concepts to non-technical audiences
- Ability to work independently and collaborate effectively in cross-functional environments
Minimum Qualifications:
- Bachelor’s degree in Information Systems, Computer Science, Data Management, or related field preferred
- 5–8 years of experience in data engineering or a similar role
- Strong SQL skills and deep knowledge of relational databases and data warehousing
- Proficiency in Python or JVM languages (e.g., Java, Scala, Kotlin) for data manipulation and automation
- Hands-on experience with cloud data platforms (e.g., AWS, Azure, or GCP)
- Solid understanding of ETL/ELT processes, data modeling, and data architecture
- Track record of owning and leading technical projects
- Experience with Agile methodologies and version control
Similar Jobs
Healthtech • Social Impact • Software • Telehealth
Build and maintain scalable, secure data pipelines and platforms to enable AI-driven analytics. Partner with analytics, product, and marketing to translate requirements, deploy production systems, implement data governance and access controls, and support AI applications at scale.
Top Skills:
AWSIcebergKafkaLarge Language Models (Llms)Model Context Protocols (Mcps)PythonSemantic LayersSnowflakeSparkSQLTerraform
Fintech • Software • Financial Services
Design, build, and maintain scalable batch and real-time data pipelines and data lake architecture. Improve observability and SLOs, optimize ETL/ELT, develop dbt workflows, support event-driven architectures, integrate financial APIs, and collaborate with analytics and ML teams to deliver reliable, model-ready data products.
Top Skills:
AirflowApache IcebergAvroAws AthenaAws GlueAws KinesisAws S3BigQueryCi/CdCloud SqlCloud StorageDbtEmrGCPGitopsParquetPrefectPythonSQLTerraform
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.
Top Skills:
Ai AgentsApache IcebergAuroraAWSAws RdsAzureDatabricksDbtFivetranGCPGoogle BigqueryMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonSnowflakeSparkSQL
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
