Design, develop, and manage data infrastructure for internal and client projects, focusing on large-scale data pipelines, APIs, and cloud deployments.
Object Computing, Inc. (OCI)
OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team.
About OCI
We provide a collaborative environment focused on innovation, leveraging open-source software and strategic partnerships with Amazon and Google to build transformative technology solutions.
Job Responsibilities
- Design, build, and optimize large-scale data pipelines (Azure, AWS, GCP)
- Develop data ingestion and storage solutions.
- Implement scalable APIs and ensure system performance.
- Manage big data infrastructure and cloud deployments.
- Collaborate with developers, designers, and data scientists.
- Work in an Agile/DevOps environment.
Core Competencies
- ETL data engineering (Databricks, SQL Server, Snowflake, BigQuery, Apache Spark).
- Proficiency in Go, Java, Python, or Scala.
- Proficiency in CI/CD pipelines and Infrastructure as Code (IaC) (Terraform, CDK, Ansible).
- Hands-on experience with event-driven architectures (Kafka, Pulsar).
- Strong knowledge of data warehousing, SQL/NoSQL databases, and cloud platforms.
- Experience with distributed computing, DevOps tools, and data governance.
- Familiarity with Delta Lake, Unity Catalog, Delta Sharing, and DLT.
Preferred Qualifications
- Degree in Computer Science, Data Engineering, or a related field, or equivalent experience.
- Experience with AI/ML-driven data solutions and real-time data processing.
- Expertise in building scalable APIs and integrating with modern analytics tools (Power BI, Tableau, QuickSight).
- Cloud certifications (Databricks, AWS, Azure, GCP).
Similar Jobs
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, and operate scalable cloud data pipelines, platforms, and applications using distributed data technologies. Lead architectural decisions, evaluate platforms such as Snowflake and Databricks, establish engineering patterns, and deliver resilient data solutions. Collaborate with product managers, software engineers, analysts, and data scientists while mentoring engineers and communicating technical outcomes to stakeholders. Drive large-scale data initiatives independently in an Agile environment.
Top Skills:
AgileAirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloNoSQLPythonRedshiftScalaSnowflakeSparkSplunkSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Data Engineering Interns will define metrics, instrument logging, ingest and model data, transform datasets, ensure data quality and governance, and support visualization, reporting, alerting, and scalable systems. They will partner with product, analytics, and data consumers to improve product engagement, efficiency, costs, and strategic decision-making. The 12-week, full-time internship includes technical training, mentorship, and hands-on project experience.
Top Skills:
PythonRelational DatabasesSQL
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.
Top Skills:
Apache AirflowAWSAzureDagsterData LakeData ModelingData PipelinesDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
