EXL Logo

EXL

Cloud Data Engineer

Posted 5 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.
The summary above was generated by AI

We are seeking an experienced AWS Data Engineer to join our Data Engineering team. You will be responsible for architecting, implementing, and managing scalable data solutions on AWS. Candidate would be required to work from NJ office as part of this role.

Responsibilities

design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
Develop and enforce standards for data quality, security, and governance.
Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
Troubleshoot complex data issues and provide technical leadership in problem resolution.

Qualifications

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
6+years of experience in data engineering.
Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
Excellent problem-solving, communication, and organizational skills.
 

Preferred Qualifications:
AWS Solutions Architect or AWS Data Engineer certification.
Experience with real-time streaming technologies.
Knowledge of data governance, compliance, and security best practices.
Familiarity with Lakehouse architecture and modern data platforms.

Similar Jobs

3 Days Ago
Remote
Location, WV, USA
111K-150K Annually
Senior level
111K-150K Annually
Senior level
Aerospace • Information Technology • Professional Services • Security • Software
Design, develop, and implement complex cloud ETL processes for healthcare data. Support ETL operations (automation, scheduling, monitoring, maintenance, security), use AWS and Snowflake, employ Python and SQL, follow Agile and CI/CD practices, and identify process improvements to meet business and system requirements.
Top Skills: AWSCi/CdDevOpsETLGitPythonSnowflakeSQL
Mid level
Software
Lead discovery, design, and implementation of end-to-end Salesforce Marketing Cloud, Data Cloud, and Personalization solutions. Translate business goals into data models, identity resolution, activation, and journey architectures. Build and configure Marketing Cloud components, Data Cloud ingestion and activations, Personalization tracking and recipes, and custom API integrations. Own solution documents, run client sessions, and deliver projects from discovery through go-live.
Top Skills: AgentforceAmpscriptAutomation StudioContent BuilderEinsteinEmail StudioJourney BuilderMobile StudioRest ApiSalesforce Data CloudSalesforce Marketing CloudSalesforce PersonalizationSoap ApiSQLSsjs
29 Days Ago
In-Office or Remote
121K-182K Annually
Senior level
121K-182K Annually
Senior level
Cloud • Information Technology • Software • Business Intelligence
The Senior Microsoft Cloud Engineer leads the design and implementation of secure collaboration capabilities across Microsoft cloud, focusing on external identity management and data protection controls.
Top Skills: AzureMicrosoft EntraMicrosoft PurviewPower BIPower PlatformPowershellSharepoint

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account