DistantJob Logo

DistantJob

Senior Data Engineer

Posted Yesterday
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Design and optimize SQL Server solutions, manage data, automate processes with PowerShell, and integrate with external systems to enhance functionality.
The summary above was generated by AI

Cheesy joke to get you to smile:

Two SQL transactions ask a minister to marry them, but the minister replies, "Only if you're willing to commit."

Summary:

We are seeking a hands-on Data Engineer who is skilled in building complex systems beyond just writing queries. This role focuses on SQL Server in both Linux and Windows environments and requires versatility across various tools, including PowerShell, APIs, Python, and emerging AI/LLM technologies. If you enjoy stretching your expertise beyond SQL and want to contribute to innovative solutions, this position is for you. The role is for one of our North American clients with proprietary software for the insurance industry.


Responsibilities:

  • Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling.
  • Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets.
  • Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE.
  • Use PowerShell, SQL Server tools, and scripting to automate processes.
  • Enhance functionalities by integrating with APIs and external systems.
  • Address problems comprehensively, focusing on end-to-end solutions beyond the database layer.
  • Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks.
  • Explore and implement LLM-driven workflows, including prompting and structured outputs.
  • Continuously enhance efficiency by replacing manual processes with automation.

Required Skills:

  • Proficient in SQL Server, including query performance, indexing, and data modeling.
  • Experience handling JSON in SQL Server and managing hybrid data models.
  • Experience with PowerShell or similar scripting languages for automation purposes.
  • Ability to work across multiple systems, including databases, APIs, and services.
  • Proven ability to deliver effective solutions in a timely manner.

Preferred Skills:

  • Background in smaller teams with end-to-end system ownership.
  • Experience in complex application environments rather than isolated reporting or analytics settings.
  • Capability to navigate and solve problems without detailed requirements.
  • Experience in insurance, financial services, or other regulated, transaction-heavy domains.
  • Python experience and familiarity with APIs and integrations.
  • Exposure to LLMs like OpenAI and Claude.
  • Experience developing internal tools or automation frameworks.
  • Experience with cloud or hybrid infrastructure.

This is a fully remote position, offering the flexibility to work from anywhere. If you are ready to take ownership and thrive in a fast-paced, adaptive environment, we encourage you to apply!

Similar Jobs

3 Hours Ago
Remote or Hybrid
160K-160K Annually
Senior level
160K-160K Annually
Senior level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
The Senior Data Engineer develops ETL/ELT pipelines and data solutions for lab operations, focusing on collaboration and continuous improvement in data processing.
Top Skills: AirflowAWSAzureGitGitPandasPower BIPythonSparkSQL
8 Days Ago
In-Office or Remote
90K-119K Annually
Senior level
90K-119K Annually
Senior level
Software
The Senior Data Engineer will design and implement data architecture, manage production data pipelines, lead projects, and ensure quality and documentation while supporting progressive politics through data-driven solutions.
Top Skills: AirflowBigQueryDagsterDbtGoogle Cloud PlatformPythonSQL
8 Days Ago
Easy Apply
Remote or Hybrid
Easy Apply
145K-170K Annually
Senior level
145K-170K Annually
Senior level
Big Data • Healthtech • Software • Analytics • Pharmaceutical • Infrastructure as a Service (IaaS)
As a Senior Data Engineer, you'll design scalable data models, build automated ETL pipelines, and mentor junior engineers while collaborating across teams.
Top Skills: AzureDbtDockerPostgresPythonSnowflakeSQLTerraform

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account