Azure, Spark, Synapse Data engineer

About the Role

Key Responsibilities

• Interface with key stakeholders and apply technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design.
• Create high level design artifacts.
• Deliver high quality code deliverables for a module.
• Lead validation for all types of testing.
• Support activities related to implementation, transition, and warranty.

Requirements

• Candidate must be located within commuting distance of Atlanta, GA or be willing to relocate to the area.
• This position may require travel to project locations.
• Bachelor's degree or foreign equivalent required from an accredited institution or three years of progressive experience in the specialty in lieu of every year of education.
• At least 4 years of Information Technology experience.
• Experience working with Azure Synapse and with KQL to query Log Analytics.
• Experience working on Spark/Scala.

Nice to Have

• At least 8 years of Spark experience in data engineering.
• Understanding of distributed computing (Spark with Scala) and Spark UI to troubleshoot issues.
• Proficient in Scala and Java.
• Familiarity with Zone based/Medallion data architecture and Delta/Parquet file formats.
• Working experience with source code repository like GIT/Azure Repos and build tools like Maven.
• Strong problem-solving skills and excellent communication skills.

Qualifications

• Bachelor's degree or foreign equivalent from an accredited institution.
• Three years of progressive experience in the specialty in lieu of every year of education.