Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.
About Urban SDK
Urban SDK is shaping the Future of Smart Cities. We are pioneers in geospatial AI technology, providing public leaders with insights and automation for mission-critical decisions. We equip critical public services with geospatial AI, enabling precise, data-driven decisions with efficiency and confidence.
Our Commitment to PeopleWe are committed to aligning business growth with professional outcomes for every employee. Our commitment has been recognized by Jacksonville Business Journal and Will Reed as a noted Best Places to Work.
About the role
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial traffic analytics applications. The ideal candidate will have experience with Python, Databricks, S3, and modern data engineering practices, including automated testing, CI/CD, and data quality monitoring.
Responsibilities
- Design, implement, and maintain scalable data pipelines and ETL/ELT workflows on Databricks and cloud platforms.
- Manage large-scale geospatial and temporal datasets stored in AWS S3.
- Collaborate with data scientists to productionize machine learning models and ensure smooth data availability.
- Implement data validation, testing, and monitoring frameworks to ensure data accuracy, consistency, and reliability.
- Optimize data storage and processing strategies to handle high volumes of traffic and mobility data efficiently.
- Develop and maintain documentation for data workflows, architecture, and processes.
- Work closely with cross-functional teams to understand data requirements and ensure timely delivery.
- Stay up-to-date with the latest trends and best practices in data engineering, cloud technologies, and big data processing.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- 3+ years of experience as a data engineer or in a similar role.
- Strong proficiency in Python and associated libraries for data engineering (pandas, PySpark, etc.).
- Hands-on experience with Databricks and Spark for large-scale data processing.
- Experience with AWS services, especially S3, and knowledge of cloud-based data architectures.
- Solid understanding of data pipeline testing, version control, and CI/CD practices.
- Experience with SQL and NoSQL databases.
- Strong problem-solving skills and attention to detail.
Preferred Skills
- Familiarity with geospatial data formats and processing (GeoJSON, Shapefiles, PostGIS).
- Experience with workflow orchestration tools (Databricks, Prefect, or similar).
- Knowledge of containerization (Docker/Kubernetes) and cloud-native data solutions.
- Experience supporting machine learning pipelines in production.
Compensation
- Location: Jacksonville, FL (Town Center Area) or Remote
- Type: Full-time
- Reports to: Director of Engineering
- Salary Based on Experience
- Annual Bonus
- Medical, Vision, Dental, 401(k)
- 21 Days Vacation
- Office Lunch provided Daily
Similar Jobs
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, and operate scalable cloud data pipelines, platforms, and applications using distributed data technologies. Lead architectural decisions, evaluate platforms such as Snowflake and Databricks, establish engineering patterns, and deliver resilient data solutions. Collaborate with product managers, software engineers, analysts, and data scientists while mentoring engineers and communicating technical outcomes to stakeholders. Drive large-scale data initiatives independently in an Agile environment.
Top Skills:
AgileAirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloNoSQLPythonRedshiftScalaSnowflakeSparkSplunkSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Data Engineering Interns will define metrics, instrument logging, ingest and model data, transform datasets, ensure data quality and governance, and support visualization, reporting, alerting, and scalable systems. They will partner with product, analytics, and data consumers to improve product engagement, efficiency, costs, and strategic decision-making. The 12-week, full-time internship includes technical training, mentorship, and hands-on project experience.
Top Skills:
PythonRelational DatabasesSQL
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.
Top Skills:
Apache AirflowAWSAzureDagsterData LakeData ModelingData PipelinesDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
