Similar Jobs
Cloud • Information Technology • Internet of Things • Professional Services • Software
Design and operate scalable data architectures, pipelines, schemas, and cloud-based data systems using Snowflake and dbt. Build AI agent orchestration systems with LangGraph and LangChain, optimize query performance and costs, and maintain data quality, security, and compliance. Collaborate with data scientists and stakeholders to deliver analytics and visualization solutions. Lead moderately complex data engineering projects from design through completion and recommend data sources, methodologies, and tools.
Top Skills:
DbtJavaKubeflowLangchainLanggraphLarge Language ModelsMachine LearningMlopsPythonRetrieval-Augmented GenerationScalaSnowflakeSnowflake Co-WorkSnowflake IntelligenceSQLTeradataVector Databases
Information Technology • Consulting
Design, build, and maintain scalable Snowflake data pipelines and workflows. Ingest, transform, and deliver data from EHRs, claims, APIs, and CRM systems into analytics-ready structures. Optimize Snowflake performance and costs through warehouse sizing, query tuning, data modeling, and security design. Implement orchestration, DevOps, version control, and CI/CD practices while collaborating with client architects and analysts. The role also involves explaining technical tradeoffs, supporting repeatable deployments, adapting to unfamiliar challenges, and mentoring others.
Top Skills:
Apache AirflowAWSAzureAzure Data FactoryBigQueryCi/CdDatabricksDbtDynamic TablesEpic CaboodleEpic ClarityFhirFlywayGCPGitHl7IcebergJavaKafkaKinesisLiquibaseNetezzaOraclePub/SubPythonRedshiftScalaSchemachangeSnowflakeSnowflake Cortex AiSnowflake StreamsSnowflake TasksSnowparkSnowpipe StreamingSQLSQL ServerStreamlitTeradataTerraform
Software
Design and build modern GCP lakehouse architectures, including Python and Spark pipelines, BigQuery ingestion, Kafka CDC, Delta Lake and Iceberg UniForm integrations, Delta Sharing endpoints, Snowflake and Databricks connectivity, data lineage, governed access controls, and semantic-layer alignment. Collaborate cross-functionally, troubleshoot full-stack issues, and deliver reusable data-sharing adapters and end-to-end data features.
Top Skills:
Apache IcebergSparkBigQueryChange Data Capture (Cdc)DatabricksDatabricks Unity CatalogDelta LakeDelta SharingGCPGoogle Cloud StorageIceberg UniformKafkaLookmlPythonSnowflakeSnowflake Horizon Catalog
The role involves designing and optimizing data pipelines in Snowflake, developing ETL workflows, collaborating on data integration, ensuring data security, and performance monitoring.
This is a remote position.
-
Snowflake Data Engineer & Developer
Position: Snowflake Data Engineer & Developer
Location: VA, MD, DC - Hybrid or Remote
Type: Full-time
Experience Level: Mid-Senior Level
Department: Data Engineering / Development
About the Role:
As a Snowflake Data Engineer & Developer working on the DoD’s Analytics Platform, you will design, develop, and optimize data pipelines, ensuring seamless data ingestion, transformation, and processing in Snowflake. You will collaborate with teams to integrate data from various sources, maintain data integrity, and ensure the platform supports DoD's mission-critical analytics.
Key Responsibilities:
- Data Pipeline Development: Build and manage efficient data pipelines for ingesting, transforming, and loading data into Snowflake.
- ETL/ELT Workflows: Develop and automate ETL/ELT processes using Snowflake, Snowpipe, and Streams & Tasks.
- Database Optimization: Design Snowflake database structures and optimize queries, ensuring high performance and scalability.
- Integration: Collaborate with other teams to integrate data from various sources (cloud, databases, APIs) into Snowflake.
- Data Security: Implement data encryption, role-based access controls (RBAC), and compliance with DoD IL5/IL6 standards.
- Data Transformation: Apply transformation logic and create reusable components for scalable data processing across the platform.
- Performance Monitoring: Monitor and tune performance, proactively identifying bottlenecks and optimization opportunities.
Required Qualifications:
- Experience:
- 3+ years of experience in data engineering, with at least 1 year of experience working with Snowflake.
- Proven experience in designing and implementing ETL/ELT workflows.
- Technical Skills:
- Proficient in SQL and Snowflake-specific capabilities (e.g., Time Travel, Snowpipe, Streams).
- Experience with cloud platforms (AWS, Azure), particularly data-related services.
- Knowledge of Python or Java for scripting and data automation.
- Security Clearance: Active U.S. DoD Secret Clearance (Top Secret/SCI preferred).
- Data Management: Experience in handling large-scale datasets, performing data integration, and ensuring data quality in a DoD or similar secure environment.
Preferred Qualifications:
- Certifications:
- Snowflake SnowPro Certification or equivalent.
- Cloud certifications (AWS or Azure) focusing on data.
- Data Tools: Experience with big data tools (e.g., Spark, Kafka, Hadoop).
- Automation: Familiarity with automation tools like Airflow and CI/CD pipelines for data workflows.
Why Join Us?:
- Directly support national defense and warfighter missions.
- Work on cutting-edge technology in the high-stakes environment of combat command analytics.
- Competitive compensation and benefits, along with growth opportunities in the DoD sector.
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
