Onebridge Logo

Onebridge

Sr. Data Engineer - Databricks

Reposted 19 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The Sr. Data Engineer - Databricks designs and maintains scalable data solutions using Apache Spark and Databricks, ensuring data quality and performance for analytics and reporting.
The summary above was generated by AI

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Sr. Data Engineer – Databricks to join our innovative and dynamic team. 

Sr. Data Engineer – Databricks | About You 

As a Sr. Data Engineer – Databricks, you are responsible for designing, building, and maintaining scalable data solutions that enable analytics, reporting, and data-driven decision-making across the organization. You bring strong experience working with modern data platforms and enjoy transforming complex data into reliable, high-quality datasets. You thrive in collaborative environments, partnering with analytics, engineering, and business teams to deliver impactful data pipelines. You are comfortable working in cloud-based ecosystems and consistently apply best practices in data engineering, data governance, and performance optimization. You take ownership of data solutions from design through deployment and ongoing optimization.

Sr. Data Engineer – Databricks | Day-to-Day 

  • Design, develop, and maintain robust and scalable data pipelines using Apache Spark and cloud-native data services.
  • Build, optimize, and support ETL and ELT workflows to enable analytics, reporting, and downstream applications.
  • Implement and manage data solutions using Databricks, Delta Lake, and Unity Catalog.
  • Ensure data quality, reliability, and performance across large-scale and complex datasets.
  • Collaborate with cross-functional teams to gather data requirements and translate them into effective technical solutions.
  • Apply data engineering best practices related to scalability, security, monitoring, and maintainability.
  • Support the continuous improvement of data architecture, pipeline performance, and operational stability in a cloud environment.

Sr. Data Engineer – Databricks | Skills & Experience 

  • 7+ years of experience in data engineering or a related technical role.
  • Strong hands-on experience with Databricks and Apache Spark.
  • Experience working with Delta Lake and Unity Catalog for data management and governance.
  • Solid understanding of data pipeline design, ETL and ELT patterns, and data modeling concepts.
  • Experience working with cloud data platforms such as Azure, AWS, or GCP.
  • Proven ability to design scalable, reliable, and high-performing data solutions.
  • Strong problem-solving skills and the ability to work effectively in collaborative, fast-paced environments.

Similar Jobs

19 Days Ago
Remote
USA
180K-270K Annually
Senior level
180K-270K Annually
Senior level
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Lead operational reliability and platform enablement for Databricks: build monitoring, CI/CD, deployment standards, compute and job policies, observability, runbooks, and governance to support secure, cost-aware, production data workloads across regulated environments. Mentor engineers and align platform with cloud/infrastructure and compliance requirements.
Top Skills: Ci/CdDatabricksDatabricks Asset BundlesDatabricks WorkflowsDelta LakeInfrastructure-As-CodeService PrincipalsUnity CatalogVersion Control (Git)
11 Days Ago
Remote
U.S.
120K-180K Annually
Senior level
120K-180K Annually
Senior level
Software
Design and build modern GCP lakehouse architectures, including Python and Spark pipelines, BigQuery ingestion, Kafka CDC, Delta Lake and Iceberg UniForm integrations, Delta Sharing endpoints, Snowflake and Databricks connectivity, data lineage, governed access controls, and semantic-layer alignment. Collaborate cross-functionally, troubleshoot full-stack issues, and deliver reusable data-sharing adapters and end-to-end data features.
Top Skills: Apache IcebergSparkBigQueryChange Data Capture (Cdc)DatabricksDatabricks Unity CatalogDelta LakeDelta SharingGCPGoogle Cloud StorageIceberg UniformKafkaLookmlPythonSnowflakeSnowflake Horizon Catalog
7 Days Ago
Remote
Georgia, USA
Senior level
Senior level
Information Technology • Software • Consulting
Lead design and delivery of Databricks-based Lakehouse solutions and end-to-end data engineering projects. Build and optimize ETL, streaming and batch pipelines, integrate cloud and on-prem systems, mentor team members, support pre-sales, and ensure governance, security, and platform performance.
Top Skills: AWSAzureDatabricksDbtDelta LakeGCPMlflowPower BIPysparkPythonScalaSparkSQLTerraform

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account