The role involves designing and building data processing pipelines, managing data accessibility and security, collaborating with teams, and mentoring junior engineers.
bout Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
-> Meet Egen
-> Life at Egen
-> Culture and Values at Egen
-> Career Development at Egen
We are seeking a seasoned Data Engineer with a minimum of 2 - 5 years of experience to join our team. The ideal candidate will possess a deep understanding of large-scale data processing systems, with a focus on designing and building both batch and streaming data pipelines. You will play a vital role in managing our data and ensuring its accessibility, security, and accuracy.
About the job:
- Design, develop, and deploy large scale data processing pipelines, both batch and streaming, using technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub.
- Expertise with multiple data storage technologies such as Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres.
- Work with stakeholders to understand business problems, develop use-cases, and translate them into pragmatic and effective technical solutions.
- Design and develop appropriate schema for data based on understanding of the domain problem.
- Manage data lineage and ensure data security with appropriate tools and methodologies.
- Collaborate with data scientists, architects, and other stakeholders to ensure alignment between technical and business strategy.
- Continuously monitor, refine and report on the performance of data management systems.
- Mentor junior data engineers, reviewing their outputs and directing their professional development.
About you:
- 2 - 4 years of experience in data engineering, particularly in designing and developing data pipelines.
- Proven expertise with technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub.
- Experience with various data storage technologies including Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres.
- Ability to design data schemas based on an understanding of the domain problem.
- Experience with data security and data lineage methodologies and tools is preferred.
- Familiarity with agile development methodologies.
- Exceptional communication skills, able to explain complex technical concepts in clear, plain English.
- BSc degree in Computer Science, Engineering or a related field, or equivalent work experience.
Nice to have:
- Experience with data migration projects
- Knowledge of dbt, Airflow, or similar orchestration tools
- Experience in multi-cloud environments
- Familiarity with data modeling and analytics use cases
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Data Engineer, you'll lead data engineering projects, develop data transformations, build workflows with Apache Airflow, and ensure data quality and integrity while collaborating with stakeholders.
Top Skills:
AirflowCi/CdDbtGitPythonRedshiftSnowflake
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Data Engineer II, you will build, scale, and optimize data platforms, focusing on ETL/ELT pipelines, and collaborate with data scientists and AI engineers to support data-driven applications and insights.
Top Skills:
DatabricksDbtPythonRdsRedshiftSnowflakeSparkSQL
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Design and implement ETL pipelines, optimize data systems, build data warehouses, and develop AI/ML models for data solutions. Collaborate with teams to deliver data-driven products and ensure data quality and governance.
Top Skills:
Apache AirflowApache KafkaAws GlueAws RedshiftFivetranJavaOraclePower BIPythonPyTorchScalaScikit-LearnSQLSQL ServerTableauTensorFlow
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
