Data Engineer

About the Role

Key Responsibilities

• Design and build data processing pipelines using tools and frameworks in the AWS ecosystem.
• Analyze requirements and architecture specifications to create detailed design documents.
• Perform data engineering functions including data extract, transformation, loading, and integration in support of cloud computing platforms like AWS.
• Work with large data sets and collaborate with Data Engineers and Data Scientists on data analysis using various algorithms.
• Implement and configure big data technologies and tune processes for performance at scale.
• Design and build ETL pipelines to automate ingestion and data migration of structured and unstructured data.
• Work with DevOps engineers on CI, CD, and IaC processes; translate specifications into code and design documents; perform code reviews.
• Ensure system scalability, performance, and availability are maintained.
• Deploy solutions in AWS environment and verify accuracy of results.
• Write complex unit and integration tests for data processing code.

Requirements

• Bachelor's degree in Computer Science or a related field.
• 5+ years of high-volume experience with Python, PySpark, Spark Engine, and Spark Dataset API.
• 2+ years of experience with Agile methodology.
• 2+ years of experience performing data pipeline and data validation.
• Ability to obtain and maintain a Public Trust Clearance.
• Reside in the U.S., authorized to work in the U.S., and all work performed in the U.S.
• Lived in the U.S. for three full years out of the last five years.

Nice to Have

• MS degree and 5+ years of technical experience.
• Experience working in the healthcare industry with PHI/PII.
• Federal Government contracting work experience.
• Experience working as part of a dynamic, interactive Agile team.
• Strong written and verbal communication skills.
• Prior experience working remotely full-time.

Qualifications

• Degree in Computer Science or related field (preferred).
• Experience with Python, PySpark, Spark, and AWS technologies.
• Experience with data pipelines, data validation, and performance tuning.

Benefits & Perks

• Pay range of $73,722.00 - $125,327.00 based on experience and qualifications.
• Remote work opportunity within the U.S.
• Potential travel for conferences or collaboration once a year.
• Inclusive workplace with accommodations available for disabilities, veterans, and religious beliefs.