PetroApp Logo

PetroApp

Senior Data Engineer

Reposted 6 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in Egypt
Senior level
Remote
Hiring Remotely in Egypt
Senior level
Design, build, and maintain scalable batch and near-real-time data pipelines and models. Ensure data quality, observability, security, and cost-efficient performance. Partner with cross-functional teams to enable analytics, support BI use cases, and mentor junior engineers while applying DevOps practices and incident management.
The summary above was generated by AI
  1. Data platform engineering: Design and maintain scalable batch and near-real-time data pipelines across mobile applications, NFC/fuel transactions, station integrations, ERP integrations, payments, support systems, and operational databases.
  2. Data modeling: Create clean, reusable data models for core entities such as customers, vehicles, drivers, stations, transactions, wallets, limits, invoices, products, maintenance services, and geographic coverage.
  3. Reliability and quality: Implement data validation, lineage, observability, alerting, reconciliation, and automated quality checks to ensure business-critical dashboards and reports are accurate and timely.
  4. Analytics enablement: Partner with analytics, product, finance, operations, and customer success teams to deliver self-service datasets, metrics layers, and well-documented data marts.
  5. Performance and cost optimization: Tune queries, storage layouts, orchestration schedules, and cloud resources to improve platform performance and manage infrastructure cost.
  6. Data governance and security: Apply data access controls, PII handling, retention practices, auditability, and compliance-aware engineering patterns across the data lifecycle.
  7. Integration engineering: Build robust ingestion patterns for APIs, webhooks, CDC, files, event streams, third-party integrations, and partner station data feeds.
  8. DevOps for data: Use CI/CD, version control, automated testing, infrastructure-as-code, and deployment standards for data pipelines and transformations.
  9. Incident management: Troubleshoot data incidents, conduct root-cause analysis, reduce recurring failures, and communicate impact clearly to stakeholders.
  10. Technical mentorship: Review designs and code, establish engineering standards, mentor junior team members, and raise the quality bar for data engineering at PetroApp.

RequirementsRequired qualifications
  • 5+ years of professional experience in data engineering, analytics engineering, platform engineering, or backend engineering with strong data ownership.
  • Advanced SQL skills, including query optimization, data modeling, window functions, incremental transformations, and large-table performance tuning.
  • Strong Python programming experience for data pipelines, automation, testing, and production-grade data workflows.
  • Hands-on experience with workflow orchestration such as Airflow, Dagster, Prefect, or similar tools.
  • Experience with modern data warehouses or lakehouse platforms such as BigQuery, Snowflake, Redshift, Databricks, Delta Lake, Iceberg, or equivalent.
  • Experience building reliable ELT/ETL pipelines using tools such as dbt, Spark, Kafka, Flink, Fivetran, Stitch, custom API ingestion, or CDC frameworks.
  • Practical understanding of data quality, schema evolution, monitoring, alerting, backfills, idempotency, and failure recovery.
  • Experience designing dimensional, wide-table, and event-based data models for BI, analytics, and operational reporting.
  • Comfort working with cloud platforms such as AWS, GCP, or Azure, plus Git-based engineering workflows.
  • Strong communication skills with the ability to translate business requirements into clear technical designs and delivery plans.
Preferred qualifications
  • Experience in fintech, payments, fleet management, logistics, mobility, marketplace, fuel, or high-volume transaction platforms.
  • Knowledge of event-driven architectures, streaming data, CDC, API integrations, data contracts, and data mesh or domain-oriented data ownership.
  • Experience supporting BI tools such as Power BI, Looker, Tableau, Metabase, Superset, or similar platforms.
  • Familiarity with MLOps or feature engineering for fraud detection, anomaly detection, forecasting, customer segmentation, or optimization use cases.
  • Experience with data privacy, access control, encryption, secrets management, and compliance expectations in the Middle East or multi-country operations.
Core technical stack expectations

The exact stack may evolve, but the successful candidate should be comfortable operating across the following categories:

  • Languages: SQL, Python; optional Scala or Java for distributed processing.
  • Transformation and modeling: dbt or equivalent; dimensional modeling; metrics layers.
  • Orchestration: Airflow, Dagster, Prefect, or similar.
  • Storage and compute: cloud warehouse, data lake/lakehouse, object storage, distributed processing.
  • Streaming and integration: Kafka or equivalent, CDC, APIs, webhooks, files, partner data feeds.
  • Engineering practices: Git, CI/CD, automated tests, Docker, Kubernetes or containerized deployment, Terraform or infrastructure-as-code.
  • Observability: data quality checks, lineage, pipeline monitoring, logs, alerts, runbooks, and service-level objectives for data products.

Benefits
  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge technology with a passionate team.
  • Career growth and development opportunities.
  • A collaborative and inclusive work environment.

Similar Jobs

10 Days Ago
In-Office or Remote
Senior level
Senior level
Information Technology
Design, build, and operate scalable cloud-native data pipelines and infrastructure to support analytics and AI workloads. Develop dimensional and semantic data models and curated data products, optimize cloud data services, maintain versioned development workflows, and collaborate with AI, Analytics, and Product teams to deliver high-quality data for LLMs, agents, and RAG solutions.
Top Skills: Ai AgentsAirflowAthenaAWSDbtGitGlueLambdaLlmsPrefectPythonRagRedshiftS3SQL
Yesterday
Remote
Senior level
Senior level
Information Technology • Machine Learning • Real Estate
Design, build, and maintain scalable data pipelines, data marts, and schemas; collaborate with data scientists and stakeholders; deploy and maintain data storage and cloud infrastructure; implement data validation and quality checks; optimize pipeline performance and evaluate new tools to improve data engineering capabilities.
Top Skills: APIsAWSAzureData WarehousesDatabasesFlinkGoogle Cloud PlatformKafkaPythonSpark StreamingSQL
7 Days Ago
Remote
Senior level
Senior level
Software
Lead design, development, and maintenance of end-to-end analytical solutions on Microsoft on-premises and Azure cloud. Elicit requirements, mentor junior engineers, deliver analytical and real-time solutions (ETL, data lake/warehouse, governance), and transfer knowledge to clients.
Top Skills: Active DirectoryAzure Data CatalogAzure Data FactoryAzure Data Lake AnalyticsAzure Data Lake Storage Gen2 (Adls Gen2)Azure DevopsAzure FunctionsAzure HdinsightAzure Key VaultAzure PurviewAzure SqlAzure Stream AnalyticsAzure Synapse AnalyticsAzure Synapse Analytics Dedicated PoolsCosmosdbDatabricksHiveKafkaMs Sql ServerPolybasePower BISnowflakeSparkSsasSsisSsrsU-Sql

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account