Virtasant Logo

Virtasant

Senior Databricks Engineer/Architect

Posted Yesterday
In-Office or Remote
Hiring Remotely in Austin, TX, USA
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX, USA
Senior level
Design and maintain scalable data pipelines, lead migrations to Databricks, optimize PySpark transformations, and build reliable ETL/ELT workflows. Ensure data quality, performance, and scalability while translating technical requirements into effective data solutions. Present architecture designs, migration roadmaps, and project outcomes to stakeholders, bridging technical teams and business leadership.
The summary above was generated by AI
Senior Databricks Engineer/Architect

Job Type: 1099 contract, long-term & ongoing

Location: Remote in US

About Virtasant

Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries.

We help organizations modernize cloud platforms, improve engineering efficiency, and optimize cloud spend through architecture, automation, and FinOps best practices.

Our teams work directly with enterprise customers to identify inefficiencies, drive modernization efforts, and deliver measurable business outcomes.

What We're Looking For

Experienced Senior Data Engineer or Data Architect specializing in designing, developing, and optimizing scalable data pipelines using PySpark and Databricks.

Skilled in architecting and executing data migrations to Databricks, modernizing data platforms, and building robust ETL/ELT workflows that ensure data quality, performance, and reliability.

Adept at translating complex technical requirements into effective data solutions, collaborating with cross-functional teams, and presenting technical strategies, architecture designs, and project outcomes to business stakeholders and leadership.

What You'll Do
  • Design, develop, and maintain scalable, high-performance data pipelines.

  • Architect and lead data migration strategies to the Databricks platform.

  • Develop and optimize complex data transformations using PySpark.

  • Build and enhance ETL/ELT processes to support enterprise data initiatives.

  • Ensure data quality, integrity, scalability, and performance across data platforms.

  • Present technical solutions, migration roadmaps, and project progress to stakeholders.

  • Bridge the gap between technical teams and business stakeholders to align data solutions with organizational objectives.

HQ

Virtasant Austin, Texas, USA Office

Austin, Texas, United States

Similar Jobs

An Hour Ago
Easy Apply
Remote
United States
Easy Apply
160K-215K Annually
Senior level
160K-215K Annually
Senior level
Artificial Intelligence • Fintech • Software • Travel
Own the full lifecycle and growth of strategic channel partnerships across associations, fintech, marketplaces, and distribution platforms. Drive revenue and GBV through performance optimization, QBRs, commercial negotiations, partner enablement, tier progression, and expansion initiatives. Build playbooks, health scoring, and scalable channel infrastructure while translating partner needs into product requests and coordinating cross-functional issue resolution.
Top Skills: CrossbeamExcelGoogle Sheets
2 Hours Ago
Remote or Hybrid
United States
56K-76K Annually
Junior
56K-76K Annually
Junior
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Own customer support cases for Ivans digital products from initial contact through resolution. Troubleshoot configuration, data, integration, API, and potential product issues; perform root-cause analysis; guide onboarding and setup; document recurring solutions; and collaborate with Product, Engineering, and integration partners. Translate technical findings into clear customer communication and well-documented escalations.
Top Skills: APIsIvans Digital ProductsSaaSStructured Data Formats
3 Hours Ago
Remote or Hybrid
Austin, TX, USA
109K-124K Annually
Junior
109K-124K Annually
Junior
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Provides administrative and concierge support to senior leaders by managing calendars, meetings, travel, confidential information, correspondence, records, expenses, and action items. Coordinates office logistics, guest services, conference rooms, virtual sessions, and special events while maintaining organized workflows and adapting to changing priorities.
Top Skills: Data Entry And Reporting ToolsOffice Productivity ToolsTravel Systems

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account