Lead enterprise data architecture and platform engineering efforts using Databricks Lakehouse. Design scalable cloud-native data platforms, implement medallion architectures, enable data governance and AI/ML workloads, build automation and CI/CD for Databricks, and mentor teams while collaborating with stakeholders on strategy and delivery.
Job Description
Job Summary
We are seeking a highly skilled and experienced Sr Big Data Engineer to drive enterprise architecture strategy, platform engineering, modernization initiatives, and end-to-end solution delivery. This role will lead data and analytics transformation efforts leveraging Databricks, cloud-native technologies, and modern data platform architectures.
The ideal candidate will partner closely with Enterprise Information Management (EIM), business stakeholders, and technology leaders to design and deliver scalable, secure, and high-performing data solutions that enable advanced analytics, AI/ML, and enterprise reporting capabilities.
This is a hands-on technical leadership role, with approximately 40% architecture and strategy, 30% engineering and platform implementation, and 30% governance, mentoring, and stakeholder collaboration.
Key Responsibilities
- Define and establish enterprise architecture patterns, standards, frameworks, and best practices for scalable data and analytics solutions.
- Design, architect, and implement modern data platforms with a focus on performance, scalability, security, reliability, and maintainability.
- Lead the adoption and enablement of Databricks Lakehouse capabilities, including Data Engineering, Data Governance, Analytics, and AI/ML workloads.
- Evaluate emerging technologies, tools, and frameworks to support enterprise business and technology objectives.
- Collaborate with business leaders, executives, data teams, and engineering organizations to translate strategic goals into technology solutions.
- Provide hands-on architectural leadership throughout the solution lifecycle, from strategy and design through implementation and operationalization.
- Conduct architecture and design reviews to ensure alignment with enterprise standards and best practices.
- Develop automation frameworks and engineering solutions to improve Databricks platform reliability, operational efficiency, and developer productivity.
- Partner with data ingestion, curation, and consumption teams to optimize data processing, platform performance, and cloud costs.
- Drive data governance, security, compliance, and data quality initiatives across the enterprise data ecosystem.
-
Mentor engineering teams and promote cloud-native, platform engineering, and modern data architecture best practices.
Required Qualifications
Education
- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field.
Experience
- 5-7 years of experience in Solution Architecture, Data Architecture, or Enterprise Architecture roles.
- 5+ years of experience designing and delivering enterprise-scale data management and analytics solutions.
- 3+ years of experience in Platform Engineering and cloud-native data platforms.
- Experience implementing medallion architectures and enterprise data models across ingestion, curation, and consumption layers.
- Strong experience architecting and implementing Data Governance, Data Quality, Metadata Management, and Data Security solutions.
- Hands-on experience with Databricks and Lakehouse architecture.
- Experience delivering cloud-based solutions using Azure, AWS, or Google Cloud Platform.
- Proven experience supporting AI/ML initiatives and modern data analytics ecosystems.
- Advanced hands-on experience with Python, PySpark, SQL, Apache Spark, Delta Lake, and distributed data-processing frameworks.
- Experience with CI/CD, Infrastructure as Code, automated testing, and production deployment of Databricks workloads.
- Experience with healthcare data standards such as FHIR, HL7, X12, HEDIS, or claims and clinical data is preferred.
To all current Molina employees: If you are interested in applying for this position, please apply through the intranet job listing.
Molina Healthcare offers a competitive benefits and compensation package. Molina Healthcare is an Equal Opportunity Employer (EOE) M/F/D/V.
Similar Jobs
Travel
Own and lead the big data infrastructure platform, including deploying, upgrading, and operating HDFS, object storage, Iceberg, monitoring, and alerting. Drive infrastructure modernization, migrate Iceberg catalogs, implement multi-tenant quotas, improve observability, and support large-scale data architecture changes. Collaborate with a parallel infrastructure engineer, share solutions, provide coverage, and influence platform architecture.
Top Skills:
Apache IcebergApache OzoneFlinkGravitinoHadoopHdfsIceberg Rest CatalogsKafkaLakekeeperMinioS3Trino
AdTech • Marketing Tech
Design and implement scalable data infrastructure and pipelines on AWS using Spark and Scala. Build fault-tolerant batch and streaming workflows, optimize storage formats and engines, enforce automated data quality checks, and collaborate with Data Science and Product teams to deliver reliable data assets and APIs.
Top Skills:
AWSBatch ProcessingCloud Data WarehousesData LakesScalaSparkSQLStreaming Pipelines
Big Data • HR Tech • Mobile • Software • Database
Senior Software Engineers will build data processing pipelines and deploy cloud technologies, focusing on big data and machine learning infrastructure. They are expected to write and deploy efficient code within a Kubernetes environment.
Top Skills:
Amazon Kinesis Data AnalyticsApache BeamApache FlinkApache HudiApache KafkaAzure DatabricksCassandraDelta LakeDockerFlumeGoogle Cloud DataflowHadoopHbaseHiveKubernetesMongoDBNifiSpark
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
