Data Engineer

About the Role

Key Responsibilities

• Create a Databricks solution for a healthcare data focused pipeline.
• Configure and maintain unity catalog to enable enterprise data lineage and data quality.
• Ensure Data Security protocols remain compliant with HITRUST certification and relevant privacy regulations (i.e., HIPAA).
• Build batch processing solutions within Databricks including automation of transformations.
• Build out performant enterprise-level medallion architecture(s).
• Build infrastructure in Databricks and AWS or Azure to process data through compiled software tools.
• Work with the business to build cost-effective and transparent data solutions.
• Help architect, build, and maintain robust and scalable data pipelines, monitoring, and performance optimization.
• Identify and implement improvements to enhance data processing efficiency.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from various sources.
• Lead design, implementation, and maintenance of custom data models for structured and unstructured data.
• Assemble large, complex data sets that meet business requirements.
• Develop and maintain data models in line with business objectives and data privacy regulations.
• Partner with internal and external stakeholders to ensure meaningful and valuable data delivery.
• Work with Data, Development, Analysts, Data Science, and Business teams to gather requirements and build solutions.
• Communicate complex technical concepts to non-technical stakeholders.
• Identify, design, and implement internal process improvements.
• Build analytics tools utilizing data pipelines to provide insights into operational efficiency and key metrics.

Requirements

• 5+ years of relevant experience in design, development, and testing of data pipeline solutions such as Data Warehouses, Data Lakes, and Data Products.
• 2+ years of experience managing and standardizing healthcare data from structured and unstructured sources.
• Expert level experience working in Databricks, AWS, and Git.
• Expert level experience working in SQL and Python.
• Experience building and managing solutions on AWS.
• Experience designing data models, data warehouses, and data lakes for data pipelining and storage.
• Familiarity with designing and building ETL and data ingestion processes and utilizing enterprise tools.
• Experience in performance tuning, query optimization, security, monitoring, and release management.
• Experience working with large, disparate, identified and de-identified data sets from multiple sources.
• Demonstrated problem-solving attitude and effective collaboration skills.
• Ability to communicate technical concepts clearly to non-technical stakeholders.

Nice to Have

• Bachelor's degree or master's degree in computer science, data engineering, or related field.
• 7+ years of relevant experience in data solutions such as Data Warehouses, Data Lakes, and Data Products.

Benefits & Perks

• Medical, Dental and Vision coverage for employees, dependents, and domestic partners.
• Employee Assistance Program (EAP).
• 401(k) Plan with company matching and profit-sharing.
• Discretionary Bonus Program.
• Flexible Spending Accounts (FSA).
• Paid Time Off (PTO) starting at 15 days per year, prorated for part-time.
• Minimum of 10 paid holidays per year.
• Family Building Benefits including adoption and fertility assistance.
• Paid Parental Leave of up to 12 weeks.
• Life Insurance & AD&D coverage.
• Short-Term and Long-Term Disability coverage.