540 Logo

540

Lead Data Engineer

Posted 5 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
Expert/Leader
Easy Apply
Remote
Hiring Remotely in USA
Expert/Leader
Lead design and implementation of scalable data pipelines and ETL in AWS, providing guidance and mentorship to engineering teams.
The summary above was generated by AI

540 is seeking a Lead Data Engineer to own the technical direction of mission-critical, cloud-based data platforms supporting high-impact federal missions.

In this role, you’ll lead the architecture and implementation of scalable data pipelines in AWS, set engineering standards, and act as a technical mentor across teams, while remaining deeply hands-on in building and evolving our data infrastructure. This is an opportunity for a senior engineer who thrives at the intersection of architecture, execution, and mentorship and wants to build modern data solutions that matter.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel (3-4x annually)
Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance
Education Requirement: Bachelor’s Degree in Computer Science or related engineering field (preferred)
540 Internal Thrive Level: Senior Software Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

  • Lead the design and implementation of enterprise-scale data pipelines and ETL processes in AWS environments
  • Provide technical leadership and architectural guidance to cross-functional engineering teams
  • Drive best practices for data modeling, pipeline optimization, and cloud infrastructure design
  • Architect and implement solutions using Python, AWS Lambda, and modern data engineering frameworks
  • Oversee code quality, conduct architectural reviews, and establish engineering standards
  • Collaborate with stakeholders to translate complex business requirements into technical solutions
  • Mentor and develop junior and senior engineers through code reviews and technical guidance
  • Troubleshoot and resolve complex data engineering challenges across the technology stack
  • Stay current with emerging technologies and recommend innovative approaches to data challenges 

REQUIRED SKILLS & EXPERIENCE

  • 9+ years of professional experience in data engineering or related technical roles
  • Demonstrated experience as a technical lead or architect on complex data projects
  • Expert-level proficiency in Python programming and software engineering best practices
  • Deep understanding of AWS services including Lambda, S3, Step Functions, Glue, EMR, Redshift, and related data tools
  • Strong experience with Git version control and collaborative development workflows
  • Proven track record of designing and implementing scalable, high-performance data solutions
  • Experience with data warehousing concepts, dimensional modeling, and analytics platforms
  • Strong understanding of CI/CD pipelines and infrastructure-as-code principles
  • Excellent communication skills with ability to explain complex technical concepts to diverse audiences
  • Currently possess or be able to obtain within 30 days of hire:
    • AWS Cloud Practitioner certification (or higher) 
    • CompTIA Security+ certification (or higher) 

NICE TO HAVE

  • Familiarity with X12/MILS processing
  • AWS certifications (Solutions Architect, Data Analytics, or similar)
  • Background in Agile/Scrum development methodologies
  • Experience with containerization technologies (Docker, ECS, EKS)
  • Familiarity with data governance and security best practices

BENEFITS & PERKS

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability 
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) 
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Top Skills

AWS
Aws Lambda
Git
Python

Similar Jobs

16 Days Ago
Remote
U.S.
180K-200K Annually
Senior level
180K-200K Annually
Senior level
HR Tech • Payments • Software • Financial Services
As Lead Data Engineer, you will design and build Benepass's data infrastructure, partner with teams to deliver data capabilities, and set the vision for data engineering. You'll ensure data governance and manage pipelines in an AWS environment while preparing for future team growth.
Top Skills: AirflowAWSDagsterDbtKafkaKinesisPythonRdsRedshiftS3SQL
5 Days Ago
Easy Apply
Remote
USA
Easy Apply
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills: AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
7 Days Ago
Easy Apply
Remote
United States
Easy Apply
147K-160K Annually
Senior level
147K-160K Annually
Senior level
Software
Lead the data strategy at Edmentum by designing scalable data pipelines, optimizing data systems, and mentoring junior engineers while ensuring compliance with data governance policies.
Top Skills: AWSAzureETLGCPHadoopPythonSparkSQL

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account