Sand Technologies Logo

Sand Technologies

Senior Data Engineer

Posted 5 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in South Africa
Senior level
Remote
Hiring Remotely in South Africa
Senior level
Design, build, and maintain scalable ETL/ELT pipelines and Lakehouse architectures using big-data and cloud technologies. Lead data modelling, streaming and batch processing, CI/CD and containerized deployments. Ensure data quality, governance, security, and support ML workflows. Mentor engineers and collaborate with cross-functional teams to deliver reliable, cost-efficient infrastructure for a UK utilities client.
The summary above was generated by AI
Senior Data Engineer

Powering the future requires serious data infrastructure. We’re looking for a Senior Data Engineer to design, scale, and champion modern data solutions for us. 

About Sand

Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across healthcare, water, energy, telecommunications and infrastructure.

Our work delivers proven real-world impact. We have built AI systems that help manage London’s water supply, supported telecom network planning across hundreds of cities, and developed digital healthcare platforms serving tens of millions of people across Africa. From intelligent command centers to AI-powered infrastructure platforms, we help organizations sense, analyze and act in complex environments.

Our people are ambitious, curious and relentlessly practical. Our teams work alongside clients in the field, solving hard problems and deploying solutions that last. With colleagues across Africa, Europe, the UK and the US, we operate across the full stack - from research and engineering to deployment and capability building.

Our mission is simple: to harness AI to solve humanity’s most pressing challenges.

About the role

As a Senior Data Engineer, your primary mission is to design, build, and maintain scalable data pipelines and robust infrastructure to support data-intensive applications and advanced analytics solutions. Working with our UK-based Utilities client, you will handle critical infrastructure data, meaning reliability, scalability, and security are paramount.

In this role, you won't just write code, you will architect modern data solutions, oversee key engineering projects, and mentor growing engineering talent. You will collaborate closely with cross-functional teams to shape the strategic direction of our data initiatives.

What you’ll do
  • Data Pipeline & ETL Development: Lead the design, implementation, and automation of scalable ETL/ELT workflows. Ingest, process, and transform large volumes of structured and unstructured data from diverse sources (including IoT and asset telemetry) into data lakes or lakehouses.
  • Modern Data Architecture & Modeling: Architect efficient, modern data solutions (e.g., Lakehouse architectures). Design and optimize data models and schemas for high-performance storage, retrieval, and analysis.
  • Big Data & Cloud Engineering: Leverage big data technologies (Spark, Kafka, Flink) and cloud-native services (AWS, Azure, or GCP) for distributed data processing and real-time streaming applications.
  • Operations, DevOps & CI/CD: Build and maintain CI/CD pipelines, manage version control, and deploy containerized solutions. Monitor infrastructure performance, identify bottlenecks, and optimize for cost-efficiency and reliability.
  • Data Quality & Governance: Implement and oversee robust data governance, quality frameworks, and security measures ensuring compliance with industry standards.
  • Collaboration & Documentation: Partner with data scientists, analysts, and business stakeholders to translate requirements into technical reality. Create clear technical documentation, including data architecture diagrams and workflow maps.
  • Leadership & Innovation: Evaluate and recommend emerging technologies and frameworks. Mentor and guide junior and mid-level data engineers, promoting engineering best practices.
Who you are
  • Proven experience as a Senior Data Engineer, or in a similar role, with hands-on experience building and optimizing data pipelines and infrastructure, and designing data architectures.
  • Proven experience working with Big Data and tools used to process Big Data
  • Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues.
  • Excellent understanding of data engineering principles and practices.
  • Excellent communication and collaboration skills to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
  • Ability to adapt to new technologies, tools, and methodologies in a dynamic and fast-paced environment.
  • Ability to write clean, scalable, robust code using python or similar programming languages. Background in software engineering is a plus.
  • Knowledge of data governance frameworks and practices.
  • Understanding of machine learning workflows and how to support them with robust data pipelines.
Desirable languages/tools
  • Core Languages: Python, SQL, Scala, or Java (for data manipulation and scripting).
  • Data Processing & Streaming: Apache Spark, Databricks, Kafka, Flink, or Spark Streaming.
  • Cloud Platforms: Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP) and their native data tools (e.g., S3/Blob, EMR, Redshift, Synapse, Glue, ADF, BigQuery, Dataflow).
  • Data Orchestration & Warehousing: Apache Airflow, modern Lakehouse patterns, or enterprise ETL tools (Informatica, Talend).
  • DevOps Tools: Git, CI/CD pipelines, and containerization tools (Docker/Kubernetes).
  • Methodologies: Advanced relational and dimensional data modeling techniques.
How we work

Due to the highly collaborative and internationally distributed nature of our work, successful candidates must be comfortable operating in small teams while contributing to larger, globally coordinated efforts. A strong sense of ownership, self-motivation and discipline in maintaining clear and consistent communication through virtual collaboration tools and video conferencing is essential.

Similar Jobs

17 Days Ago
In-Office or Remote
Senior level
Senior level
Fintech • Software • Financial Services • Cryptocurrency
As a Senior Data Engineer, you'll build and manage data pipelines, ensure data quality, and collaborate across teams, contributing to the Data Platform's growth.
Top Skills: Ci/CdClickhouseDockerKafkaKinesisMskPythonRedpandaSQLTerraformTimescaledb
4 Hours Ago
Remote or Hybrid
200M-200M Annually
Mid level
200M-200M Annually
Mid level
Information Technology • Mobile • Consulting
The role involves building data lakes, developing data pipelines, ensuring data quality, collaborating with teams for analytics, and maintaining data dashboards.
Top Skills: AIAirflowDbtDockerGCPGreat ExpectationKubernetesLookerLuigiMlMongoDBNoSQLPrefectPysparkPythonScalaSQLTerraform
3 Hours Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Big Data • Software • Business Intelligence
Design, build, and operate AWS-first data platforms. Manage ETL/ELT pipelines, engage with clients, ensure data quality, and collaborate with teams.
Top Skills: AirflowAWSDbtPythonRedshiftS3Snowflake

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account