Senior Data Engineer

Neuehealth

Minneapolis, MN

Full Time

Senior

16 days ago

Job Description

About the Role

Senior Software Engineers spend most of their time hands-on in the creation, feature development, and subsequent maintenance of NeueHealth properties. The more senior their level, the more that individual will assist in the continuous improvement of the team's productivity and overall design of our systems. Additionally, senior talent plays a key role in building and maintaining a culture which focuses on making sure every engineer progresses in their career in line with personal goals/expectations.

Key Responsibilities

Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and T-SQL.
Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores.
Develop and optimize processes for fine-tuning large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to enhance AI-driven solutions.
Participate in building and owning a culture of DevOps and Quality Assurance.
Continuously document your code, framework standards, and team processes.
Build and support Data Ingestion frameworks deployed in Azure.
Other duties and responsibilities as assigned.

Requirements

Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience required.
Around five (5) years of experience in an enterprise or commercial software development environment.
Enterprise development experience coding in Scala.
Experience building batch and streaming data pipelines (Scala).
Experience with API design.
Extensive experience developing data-intensive solutions in a Cloud environment.
Extensive experience developing solutions that use event sourcing and/or Big Data architectures.

Nice to Have

Experience engineering big-data solutions using technologies like Databricks, Hive, and Spark.
Experience with functional programming in Scala and C#.
Experience building distributed systems with microservices and/or service-oriented architectures.
Experience working within an Azure environment. Hands on Azure admin and DevOps experience is a plus.
Experience with MLOps or LLMOps for deploying and managing machine learning workflows.
Familiarity with containerization/virtualization, e.g., Docker, Kubernetes.
Familiarity with Databricks infrastructure management.
Familiarity with CI/CD best practices.