Lead big data projects employing AWS and various programming languages to enhance data engineering, security, and ETL processes. Ensure adherence to project standards and timelines while fostering team collaboration and resource management.
Strong experience in programming languages of SAS, PL/SQL,Unix shell scripts, Python. Proficiency in Amazon Web Services (AWS) architecture and technologies such as S3, Redshift, RDS, Glue (Catalog and ETL), EMR, Lambda, Step Functions, SQS/SNS, and ECS, CloudWatch, Secrets Manager among others Experience in one or more of the following software skills: API Gateway, JSON, PARQUET, XML, Docker, Urban Code, Jenkins, GITLab, Terraform Strong experience in data engineering, data warehousing, data security and ETL processes Experience creating and using APIs for developing or programming software Strong SQL Experience Strong analytical and problem-solving skills Ability to drive code reviews with peers and managers to ensure that each increment adheres to original vision as described in the user story and all standard resource libraries and architecture patterns as appropriate 5+ years' AWS cloud-based technology services experience Must be a self-starter and motivated to learn new technologies, skills, and knowledge required by duties and responsibilities in required timeframe Adept at leading resources, and people to ensure successful on schedule project completion
Top Skills
Api Gateway
AWS
Cloudwatch
Docker
Ecs
Emr
Gitlab
Glue
Jenkins
JSON
Lambda
Parquet
Pl/Sql
Python
Rds
Redshift
S3
SAS
Secrets Manager
Sns
SQL
Sqs
Step Functions
Terraform
Unix Shell Scripts
Urban Code
XML
Similar Jobs
Information Technology • Consulting
Lead the development of data pipelines and transformations in Azure Databricks, converting Scala programs to PySpark while leveraging various Azure technologies.
Top Skills:
AdfAzure Data Lake Gen 2Azure DatabricksDelta LakePysparkPythonSparkSynapse Analytics
Information Technology • Consulting
The Big Data Lead will manage database development, ETL/ELT processes, and data warehousing, optimizing performance and ensuring data pipelines work reliably.
Top Skills:
AWSAws GlueAws S3AzureAzure BlobAzure Data FactoryAzure DevopsGitJenkinsOracleSnowflakeSQLTalendTeamcity
Information Technology • Consulting
The Senior Azure Data Engineer will manage data ETL processes, mentor junior staff, and work on cloud technologies in Azure. Required experience includes Datawarehouse expertise.
Top Skills:
AdfAzureDatabricksDatawarehousePysparkPython
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
