Senior Data Engineer

JOB SUMMARY 

Senior Data Engineers spend most of their time hands-on in the creation, feature development, and subsequent maintenance of NeueHealth properties. The more senior their level, the more that individual will assist in the continuous improvement of the team's productivity and overall design of our systems. Additionally, senior talent plays a key role in building and maintaining a culture which focuses on making sure every engineer progresses in their career in line with personal goals/expectations.    

DUTIES & RESPONSIBILITIES 

• Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala.  May include development with C# and T-SQL.  
• Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores.
• Develop and optimize processes for fine-tuning large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to enhance AI-driven solutions.   
• Participate in building and owning a culture of DevOps and Quality Assurance.
• Continuously document your code, framework standards, and team processes.
• Build and support Data Ingestion frameworks deployed in Azure.
• Other duties and responsibilities as assigned.

EDUCATION AND PROFESSIONAL EXPERIENCE 

• Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience required.
• At least eight (8) years of experience in an enterprise or commercial software development environment is required.
• Familiarity with Healthcare concepts and data models, gained through working with healthcare data, is required.
• Enterprise development experience coding in Scala.
• Experience building batch and streaming data pipelines (Scala).
• Experience with API design.
• Extensive experience developing data-intensive solutions in a Cloud environment.
• Extensive experience developing solutions that use event sourcing and/or Big Data architectures.

PREFERRED QUALIFICATIONS

• Experience engineering big-data solutions using technologies like Databricks, Hive, and Spark.
• Experience with functional programming in Scala and C#
• Experience building distributed systems with microservices and/or service-oriented architectures
• Experience working within an Azure environment. Hands on Azure admin and DevOps experience is a plus.
• Experience with MLOps or LLMOps for deploying and managing machine learning workflows.
• Familiarity with containerization/virtualization, e.g., Docker, Kubernetes
• Familiarity with Databricks infrastructure management
• Familiarity with CI/CD best practices