As a Senior Data Platform Engineer II, you will architect and manage high-performance data environments, optimizing Databricks and Snowflake systems for healthcare analytics while mentoring junior engineers.
As a Senior Data Platform Engineer II, you will architect and manage the high-performance, distributed data environments that power our healthcare analytics. You will move beyond traditional maintenance to ensure our Databricks Lakehouse and Snowflake environments scale indefinitely. You will be responsible for the health, optimization, and security of our data platforms, making complex data accessible and expressive for web applications and AI.
Primary Duties:
- Develop and implement scalable and performant solutions.
- Partner, as a peer, with Engineering Managers, Product Managers, and stakeholders throughout Aledade to develop and execute technical roadmaps using Agile processes.
- Mentor and coach more junior engineers including thorough pull request reviews for other developers and be receptive to critical feedback on your own work.
Minimum Qualifications:
- BS/BTech (or higher) in Computer Science, Engineering or a related field or equivalent experience.
- 6+ years experience as an engineer building and optimizing highly scalable distributed data systems (e.g., Databricks, Spark, or Snowflake).
- 3+ years of experience working with SQL and data modeling on large multi-table data sets.
- 3+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
- 3+ years of experience coaching other engineers.
Preferred KSA’s:
- Databricks & Lakehouse Architecture: Deep expertise in managing Databricks workspaces, including Unity Catalog for data governance, lineage, and fine-grained access control.
- Infrastructure as Code (IaC): Advanced proficiency with Terraform (or similar) to automate the provisioning and scaling of Databricks clusters, cloud resources (AWS preferred), and networking.
- Snowflake Proficiency (Nice-to-Have): Experience managing Snowflake environments, specifically focusing on warehouse cost optimization, security integration, and secure data sharing.
- Modern Database Internals: In-depth knowledge of distributed systems, including partitioning, liquid clustering/Z-Ordering, sharding, and high-availability strategies for petabyte-scale data.
- Observability & Optimization: Proven track record in performance monitoring and query tuning for distributed workloads to ensure system reliability and cost-efficiency.
- Data Engineering Lifecycle: Experience designing and optimizing high-throughput ETL/ELT pipelines and ingestion systems (batch and streaming) using Spark.
- Deployment & Orchestration: Experience building robust CI/CD pipelines for data infrastructure and deploying services using containerization (Docker, Kubernetes).
- Sensitive Data Handling: Expertise in building systems that handle protected information, with specific experience in HIPAA and SOX compliance frameworks.
- Healthcare Data Expertise: Experience navigating health-tech data complexities, such as Electronic Health Records (EHR), clinical data formats (HL7/FHIR), and claims data.
Platform & Infrastructure (The "Databricks/Cloud" Core)
Performance, Reliability & DevOps
Security, Compliance & Domain Knowledge
Physical Requirements:
- Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.
Top Skills
AWS
Databricks
Docker
Kubernetes
Snowflake
Spark
SQL
Terraform
Aledade Austin, Texas, USA Office
Austin, Texas, United States
Similar Jobs
Gaming
The Senior Data Platform Engineer will manage AWS and Databricks environments, support ETL processes, and collaborate with data teams to optimize infrastructure and costs while ensuring security best practices.
Top Skills:
AWSDatabricksGithub ActionsJenkinsPythonSQLTerraform
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Technical Account Manager, you will onboard customers, drive technical support, engage with clients, and lead project implementations while advocating for customer success.
Top Skills:
ItilLinuxmacOSPmpWindows Server
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Senior Manager of Sales Operations will drive growth and operational strategy for a $1B+ business unit, working closely with sales leadership to optimize processes and forecasting.
Top Skills:
ClariExcelGoogle SuiteSalesforceTableau
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
