The Senior Data Engineer processes structured and unstructured data, validates data quality, develops data products, supports Agile planning, and monitors emerging technologies.
Company
Cox Automotive - USAJob Family Group
Job Profile
Management Level
Flexible Work Option
Travel %
Work Shift
Compensation
Compensation includes a base salary in the range of $101,500.00 - $169,100.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate’s knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program.Job Description
The Senior Data Engineer is responsible for processing structured and unstructured data, validating data quality, and developing and supporting data products. The Senior Data Engineer also plays a role in Agile planning, providing advice and guidance, and monitoring emerging technologies.
WHAT YOU'LL DO
KEY RESPONSIBILITIES:
Process Structured and Unstructured Data
- Gathers and processes raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
- Understands and enforces appropriate data master management techniques.
Data Validation and Quality
- Ensures data quality and implements tools and frameworks for automating the identification of data quality issues.
- Work with internal and external data providers on data validation providing feedback and making customized changes to data feeds and data mappings.
Agile Planning
- Understands the challenges that the analytics organization faces in their day-to-day work and partner with them to design viable data solutions.
- Recommends improvements to processes, technology, and interfaces that improve the effectiveness of the team and reduce technical debt.
Product Development
- Implements and optimizes data solutions in enterprise data warehouses and big data repositories.
- Installs, maintains, monitors, and supports business intelligence, distributed computation, and big data analytics tools.
Application Support
- Provides ongoing support, monitoring, and maintenance of deployed products.
Advice and Guidance
- Actively works with less experienced data engineers providing technical guidance and oversight.
Emerging Technology Monitoring
- Actively participates in the engineering community, staying up to date on new data technologies and best practices and shares insights with others in the organization.
WHO YOU ARE
REQUIRED QUALIFICATIONS:
- Must live within a commutable distance to Atlanta GA
- Applicants must currently be authorized to work in the United States for any employer without current or future sponsorship. No OPT, CPT, STEM/OPT or visa sponsorship now or in future.
- Bachelor’s degree in Computer Science or related field and 4+ years related experience OR Masters Degree w/ 2+ years experience OR 16 years experience of equivalent combination of industry related professional experience and education.
- Working experience with batch and real-time data processing frameworks
- Must have strong working experience with data modelling, data access, schemas, and data storage techniques within Snowflake
- Working experience in design, development, and implementation of highly scalable, high-volume software systems and components, client-facing web applications, and major Internet-oriented applications and systems
- Working experience working with relational databases such as SQL, MySQL, Postgres/PostgreSQL
- Working experience with business intelligence tools and platforms
- Working experience with data quality tools
- Working experience with application lifecycle methodologies (e.g. waterfall, agile, iterative)
- Experience with ETL processes and tools
- Experience working with Git
- Experience working with AI related tools such as co-pilot
- Experience implementing new tools into environments
PREFERRED QUALIFICATIONS:
- Experience or exposure to DBT
- Scrum Developer Certification or equivalent
- Working experience with Sisense platform
- Working experience with SQL Server Integration Services
- Working experience with AWS data tools (Database Migration Service)
- Working experience with Python
- Experience working with Jira, Rally or similar tools
Drug Testing
Benefits
About Us
Similar Jobs
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
The Senior Data Engineer designs and maintains data systems, develops data pipelines for ingestion and analysis, and optimizes data architecture to support business needs.
Top Skills:
AirflowAWSAws GlueAzureDbtFlinkGCPIcebergJavaKafkaParquetPythonScalaSparkSQL
Automotive • Information Technology • Logistics • Software
As a Senior Data Engineer, you design and maintain data pipelines and infrastructures to support analytical products, ensuring reliability and scalability. You collaborate with teams to process vast datasets and enhance data-driven decision-making through advanced analytics, machine learning, and automation.
Top Skills:
Apache AirflowAWSDagsterDbtEc2Genai ToolsKafkaLambdaPandasPysparkPythonS3SnowflakeSparkSQLStreamlitTableau
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Senior Data Engineer processes structured and unstructured data, validates quality, develops data products, and provides guidance. Responsibilities include data processing, quality assurance, Agile planning, product development, and supporting deployed applications while monitoring emerging technologies.
Top Skills:
Aws Data ToolsBusiness Intelligence ToolsData Quality ToolsDbtGitMySQLPostgresPythonSnowflakeSQL
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

.png)
