EXL Logo

EXL

Senior Databricks Engineers

Posted 8 Days Ago
Be an Early Applicant
In-Office
Austin, TX, USA
Senior level
In-Office
Austin, TX, USA
Senior level
Designs and implements scalable Databricks Lakehouse solutions, including batch and real-time pipelines, data integration, governance, security, and quality frameworks. Leads technical architecture for analytics workloads, optimizes performance and costs, supports cloud migration and warehouse modernization, documents standards, and resolves complex platform issues. Collaborates with stakeholders and technical teams to deliver healthcare data platforms supporting reporting and operational decisions.
The summary above was generated by AI

Databricks Data engineer (Remote, USA)

Position Summary

We are seeking an experienced Databricks Solution Architect to join our growing healthcare analytics team. This is a full-time, remote position based in the United States. The ideal candidate will have strong hands-on experience designing and implementing scalable data solutions on Databricks and cloud platforms, with a deep understanding of healthcare data and modern data architecture.

This role is an individual contributor position responsible for solution design, technical leadership, and delivering high-quality data platforms that support analytics, reporting, and operational decision-making.

 

Key Responsibilities

  • Design and implement scalable data solutions using Databricks Lakehouse architecture.
  • Develop and optimize batch and real-time data pipelines for large-scale data processing.
  • Lead technical solution design for data integration, transformation, and analytics workloads.
  • Collaborate with business stakeholders, data engineers, analysts, and product teams to translate requirements into technical solutions.
  • Implement data governance, security, and data quality best practices using Unity Catalog and related technologies.
  • Optimize performance, reliability, and cost efficiency of Databricks workloads.
  • Support data warehouse modernization and cloud migration initiatives.
  • Create architecture documentation, technical standards, and design guidelines.
  • Troubleshoot complex data platform issues and provide technical recommendations.
  • Stay current with Databricks and cloud platform capabilities and drive adoption of best practices.
 

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • Minimum 5 years of experience in data engineering, data architecture, or related technical roles.
  • Hands-on experience with Databricks in enterprise environments.
  • Strong knowledge of PySpark, Spark SQL, Python, and SQL.
  • Experience designing and implementing Lakehouse architectures.
  • Experience building scalable ETL/ELT data pipelines.
  • Strong understanding of data modeling, data warehousing, and analytics platforms.
  • Experience working with structured and unstructured data.
  • Strong problem-solving and communication skills.
  • Ability to work independently in a remote environment.
  • Experience implementing data governance and security frameworks.
 

Preferred Qualifications

  • Experience in the healthcare industry, including claims, clinical, provider, member, or revenue cycle data.
  • Experience with Azure, AWS, or GCP cloud platforms.
  • Exposure to machine learning and AI/ML workloads on Databricks.
 

Certifications

Required:

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

Preferred:

  • Cloud platform certifications (Azure, AWS, or GCP)

Responsibilities

Databricks Data engineer (Remote, USA)

Position Summary

We are seeking an experienced Databricks Solution Architect to join our growing healthcare analytics team. This is a full-time, remote position based in the United States. The ideal candidate will have strong hands-on experience designing and implementing scalable data solutions on Databricks and cloud platforms, with a deep understanding of healthcare data and modern data architecture.

This role is an individual contributor position responsible for solution design, technical leadership, and delivering high-quality data platforms that support analytics, reporting, and operational decision-making.

 

Key Responsibilities

  • Design and implement scalable data solutions using Databricks Lakehouse architecture.
  • Develop and optimize batch and real-time data pipelines for large-scale data processing.
  • Lead technical solution design for data integration, transformation, and analytics workloads.
  • Collaborate with business stakeholders, data engineers, analysts, and product teams to translate requirements into technical solutions.
  • Implement data governance, security, and data quality best practices using Unity Catalog and related technologies.
  • Optimize performance, reliability, and cost efficiency of Databricks workloads.
  • Support data warehouse modernization and cloud migration initiatives.
  • Create architecture documentation, technical standards, and design guidelines.
  • Troubleshoot complex data platform issues and provide technical recommendations.
  • Stay current with Databricks and cloud platform capabilities and drive adoption of best practices.
 

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • Minimum 5 years of experience in data engineering, data architecture, or related technical roles.
  • Hands-on experience with Databricks in enterprise environments.
  • Strong knowledge of PySpark, Spark SQL, Python, and SQL.
  • Experience designing and implementing Lakehouse architectures.
  • Experience building scalable ETL/ELT data pipelines.
  • Strong understanding of data modeling, data warehousing, and analytics platforms.
  • Experience working with structured and unstructured data.
  • Strong problem-solving and communication skills.
  • Ability to work independently in a remote environment.
  • Experience implementing data governance and security frameworks.
 

Preferred Qualifications

  • Experience in the healthcare industry, including claims, clinical, provider, member, or revenue cycle data.
  • Experience with Azure, AWS, or GCP cloud platforms.
  • Exposure to machine learning and AI/ML workloads on Databricks.
 

Certifications

Required:

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

Preferred:

  • Cloud platform certifications (Azure, AWS, or GCP)

Qualifications

Databricks Data engineer (Remote, USA)

Position Summary

We are seeking an experienced Databricks Solution Architect to join our growing healthcare analytics team. This is a full-time, remote position based in the United States. The ideal candidate will have strong hands-on experience designing and implementing scalable data solutions on Databricks and cloud platforms, with a deep understanding of healthcare data and modern data architecture.

This role is an individual contributor position responsible for solution design, technical leadership, and delivering high-quality data platforms that support analytics, reporting, and operational decision-making.

 

Key Responsibilities

  • Design and implement scalable data solutions using Databricks Lakehouse architecture.
  • Develop and optimize batch and real-time data pipelines for large-scale data processing.
  • Lead technical solution design for data integration, transformation, and analytics workloads.
  • Collaborate with business stakeholders, data engineers, analysts, and product teams to translate requirements into technical solutions.
  • Implement data governance, security, and data quality best practices using Unity Catalog and related technologies.
  • Optimize performance, reliability, and cost efficiency of Databricks workloads.
  • Support data warehouse modernization and cloud migration initiatives.
  • Create architecture documentation, technical standards, and design guidelines.
  • Troubleshoot complex data platform issues and provide technical recommendations.
  • Stay current with Databricks and cloud platform capabilities and drive adoption of best practices.
 

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • Minimum 5 years of experience in data engineering, data architecture, or related technical roles.
  • Hands-on experience with Databricks in enterprise environments.
  • Strong knowledge of PySpark, Spark SQL, Python, and SQL.
  • Experience designing and implementing Lakehouse architectures.
  • Experience building scalable ETL/ELT data pipelines.
  • Strong understanding of data modeling, data warehousing, and analytics platforms.
  • Experience working with structured and unstructured data.
  • Strong problem-solving and communication skills.
  • Ability to work independently in a remote environment.
  • Experience implementing data governance and security frameworks.
 

Preferred Qualifications

  • Experience in the healthcare industry, including claims, clinical, provider, member, or revenue cycle data.
  • Experience with Azure, AWS, or GCP cloud platforms.
  • Exposure to machine learning and AI/ML workloads on Databricks.

Certifications

Required:

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

Preferred:

  • Cloud platform certifications (Azure, AWS, or GCP)

Similar Jobs

6 Minutes Ago
In-Office
86K-100K Annually
Mid level
86K-100K Annually
Mid level
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Manages supply chain planning across airplane programs, including material requirements, production schedules, inventory optimization, order releases, delivery performance, excess inventory, forecasting, and process improvements. Analyzes supply and demand issues, resolves order delinquencies, supports proposals, and applies ERP and supply chain methodologies to improve materials management and overall supply chain performance.
Top Skills: ErpErplnExcelMS OfficeOutlookPowerPointSAPWord
36 Minutes Ago
Hybrid
Entry level
Entry level
Fintech • Financial Services
Build customer relationships and support everyday banking needs through account openings, service requests, credit applications, cash handling, and referrals. Identify customer needs, recommend relevant banking products and digital tools, conduct proactive outreach, maintain compliant and accurate transactions, manage risk, and collaborate with branch specialists. The role requires Saturday availability, SAFE registration, and flexibility between teller and customer banking activities.
36 Minutes Ago
Hybrid
Senior level
Senior level
Fintech • Financial Services
Leads a consumer banking branch by coaching and developing employees, driving customer engagement and business growth, managing operational excellence, and ensuring regulatory and risk compliance. The Branch Manager allocates resources, resolves customer and employee issues, builds internal and community partnerships, supports digital banking adoption, hires and mentors talent, and oversees mortgage-related SAFE and Loan Originator requirements.
Top Skills: NmlsRegulation ZSafe Mortgage Licensing Act

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account