Data Engineer Programmer NCCT CTMC

About the Role

Key Responsibilities

• Attend project and departmental meetings and contribute to the project design concerning data management needs.
• Collaborate with faculty, team leads, and stakeholders to anticipate, define, and satisfy data needs.
• Build custom ingestion pipelines to incorporate data from novel sources.
• Ensure visibility on the status of automated data tasks to catch mistakes early.
• Collaborate with team members to improve performance and stability of data transformation tasks.
• Participate in design conversations to improve the architecture of data infrastructure.
• Support team in identifying and implementing data integration and quality control strategies.
• Prepare research data for ingestion and conversion to a unified data standard using ETL and automation tools.
• Maintain the database environment by creating views/queries, documentation, and data pipelines.
• Own data integrity, availability, documentation, and efficient access to data.
• Identify opportunities for process improvement in the data development and delivery lifecycle.
• Incorporate automation to enhance data access and analysis.

Requirements

• Bachelor's Degree in an applicable field with 3 years of experience working on full-cycle data analytics and visualization projects or an equivalent combination of education and experience.
• Experience with data replication tools or services such as Meltano, Airbyte, Fivetran, or Stitch.
• Experience with orchestration tools such as Airflow, Luigi, Prefect, or Dagster.
• Experience using scalable and distributed compute, storage, and networking resources, especially in Azure and Snowflake data stack.
• Knowledge of code versioning systems such as Git.
• Familiarity with common file formats like Parquet, ORC, or Avro, and high-performance table formats such as Apache Iceberg or Delta Lake.
• Additional consideration given for experience with tools, languages, data processing frameworks, and databases such as R, Python, SQL, MongoDB, Redis, Hadoop, Spark, Hive, Scala, BigTable, Cassandra, Presto, Strom.
• Experience with healthcare and/or biomedical research operations and systems is a plus.
• Strong initiative and ability to work independently.
• Proven ability to handle work of increasing complexity with moderate supervision.
• Superior problem-solving skills.
• Ability to communicate professionally with customers and staff.

Nice to Have

• Experience with healthcare and/or biomedical research operations and systems.

Qualifications

• Bachelor's Degree in an applicable field with 3 years of relevant experience or equivalent education and experience.

Benefits & Perks

• Base compensation within the pay range based on qualifications and experience.
• Premium pay such as shift and on-call pay.
• Opportunity for annual performance-based increases.
• Health and welfare benefits including medical, dental, vision, life, and disability insurance.
• Flexible Spending Accounts for healthcare and dependent care.
• Family benefits such as adoption assistance and paid parental leave.
• Defined contribution retirement plans with employer match.
• Educational Assistance Program.