Xpanse Logo

Xpanse

Lead, Data Engineer

Posted An Hour Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
The Lead, Data Engineer leads the data engineering team, designing scalable data solutions, mentoring staff, and ensuring data quality while collaborating with stakeholders to meet business goals.
The summary above was generated by AI

Summary:

The Lead, Data Engineer is responsible for providing technical leadership and strategic direction to the data engineering team. This role leads the design, development, and optimization of complex data pipelines and architectures to support enterprise data needs. The Lead, Data Engineer ensures that data solutions are scalable, secure, and aligned with business objectives. This position also plays a critical role in mentoring team members, collaborating with cross-functional stakeholders, and driving continuous improvement and innovation across data engineering practices.

Essential Job Duties and Responsibilities:

  • Provide hands-on technical leadership to the data engineering team. Guide the design and implementation of high-quality, scalable data solutions that meet business and analytical needs.

  • Design and maintain scalable and efficient data architectures and data pipelines. Ensure data systems are aligned with organizational goals, security standards, and best practices.

  • Lead end-to-end delivery of data engineering projects, including planning, task coordination, prioritization, execution, and quality assurance. Ensure deliverables meet deadlines and quality standards.

  • Mentor junior and mid-level data engineers by offering technical support, code reviews, and professional development guidance. Promote a collaborative and growth-oriented team culture.

  • Partner with data scientists, analysts, product managers, and business leaders to gather requirements, understand use cases, and deliver tailored data solutions. Effectively communicate technical concepts to non-technical stakeholders.

  • Enforce data quality assurance protocols, security standards, and compliance with data governance policies. Implement monitoring and validation processes for data accuracy and reliability.

  • Monitor, evaluate, and optimize the performance of data pipelines and storage systems. Proactively identify and resolve bottlenecks to improve system efficiency and scalability.

  • Stay current with evolving technologies and methodologies in data engineering. Lead initiatives to improve team practices, automate workflows, and adopt new tools that enhance productivity.

  • Take ownership of critical data engineering initiatives. Serve as a role model for technical excellence, accountability, and problem-solving.

  • Contribute to long-term planning and strategy development around data platforms, architecture, and governance. Provide recommendations and insights to senior leadership on emerging trends and technology investments.

  • Comply with all company policies and procedures.

  • Maintain regular and punctual attendance.

Other Job Duties and Responsibilities:

Performs other related duties as assigned.

Supervisory Responsibilities:

  • This position is an individual contributor with no direct reports but may provide guidance, leadership, or training to others.

Qualifications:

To perform this job successfully, an individual must be able to perform each essential function satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.

Education and/or Experience:

  • Bachelor’s Degree from a Four (4) year College or University in Computer Science, Engineering, Information Systems, or a related field. Master’s degree preferred.

  • 6+ years of progressive experience in data engineering

Certificates, Licenses, Registrations:

  • SnowPro CORE Certification or ability to obtain within 90 days of hire

Work Complexity:

Problems and issues faced are numerous and undefined, and require detailed information gathering, analysis and investigation to understand the problem, as well as experience in the financial/mortgage (or job-specific) industry. Problems typically impact multiple departments or specialties. Problems are typically solved through drawing from prior experience and analysis of issues.

Work Environment:

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Work is normally performed in a typical interior office work environment which does not subject the employee to any hazardous or unpleasant elements. The noise level in the work environment is usually moderate.

Physical Demands:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is frequently required to sit and talk or hear. The employee is occasionally required to stand; walk; use hands to finger, handle, or feel; and reach with hands and arms. The employee must occasionally lift and/or move up to 25 pounds.

Equal Employment Opportunity:

The company is committed to providing equal employment opportunities to all employees and applicants without regard to race, ethnicity, color, sex, marital status, sexual orientation, gender identity or expression, pregnancy, religion, national origin, age (40 and over), disability, military status, genetic information, or any other basis protected by applicable federal, state, or local laws.

Americans with Disabilities Act:

Applicants as well as employees who are or become disabled must be able to satisfactorily perform the essential job functions of the position either with or without reasonable accommodation. Applicants as well as employees are encouraged to meet with Human Resources as the organization shall review reasonable accommodations on a case-by-case basis in accordance with applicable law.

Job Responsibilities:

The statements reflect the general duties and responsibilities considered necessary to perform the essential functions of the job and should not be considered as an all-inclusive list of all the work requirements of the position. The company may change the specific job duties with or without prior notice based on the needs of the organization.

Top Skills

Data Architectures
Data Engineering
Data Governance
Data Pipelines
Snowpro Core Certification

Similar Jobs

16 Days Ago
Remote or Hybrid
Richmond, VA, USA
176K-201K Annually
Senior level
176K-201K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Lead Data Engineer will design, develop, and support cloud-based data solutions, lead Agile teams, and mentor engineers while utilizing various technologies including Java and Python.
Top Skills: AWSCassandraDatabricksEmrGCPGurobiHadoopHiveJavaKafkaMapreduceAzureMongodbMySQLPythonScalaSnowflakeSparkSQL
2 Days Ago
In-Office or Remote
Atlanta, GA, USA
160K-230K Annually
Senior level
160K-230K Annually
Senior level
Fintech • Gaming • Mobile • Sports • Esports
As a Staff Data Engineer, you will build and maintain data pipelines, collaborate with data teams, and ensure data infrastructure efficiency.
Top Skills: AirflowAlloydbArgoBigQueryBigtableCloud ComposerData StreamDatadogDataprocElk StackFastapiGCPGitGoGoogle Cloud Deployment ManagerGrafanaHevoMaterializeNoSQLPostgresPrometheusPythonRedisSparkSQLStreamlitTerraform
7 Days Ago
Remote or Hybrid
3 Locations
102K-171K Annually
Senior level
102K-171K Annually
Senior level
eCommerce • Information Technology • Retail • Industrial
As a Senior Data Engineer, you will design and maintain scalable data pipelines, develop data products, and collaborate across teams to deliver insights.
Top Skills: SparkAws GlueCloudFormationDockerGithub ActionsKafkaKubernetesPostgresPythonSap S/4HanaScalaSnowflakeSQLTerraform

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account