Senior Data Engineer

About the Role

Key Responsibilities

• Design, develop, and deploy cloud data solutions for risk, regulatory, finance, and compliance projects.
• Support the on-premises to cloud migration initiative and cloud consolidation strategy.
• Build technical architecture for the Azure platform and support the growth and scale of cloud-based infrastructure.
• Develop complex interface processes, troubleshoot issues, and support weekend maintenance and production activities.
• Work with business teams, product managers, and stakeholders to understand requirements and address process gaps.
• Engage with IT systems architects, database administrators, and cybersecurity teams to meet application demands.
• Coordinate with other technology and development teams for application integration.
• Participate in development meetings to align priorities, assign tasks, and share challenges.
• Provide technical guidance on technology implementation and architectural changes.
• Analyze and design technical solutions on Azure to meet business needs.
• Develop, test, and modify software to improve data platform efficiency.
• Own projects end-to-end, working with stakeholders to ensure accurate and insightful outcomes.
• Integrate data from various sources, ensuring data quality and accessibility standards.
• Enable streaming data use-cases and implement standard design patterns in a big data environment.
• Review code changes and support deployment to production.

Requirements

• Extensive experience with Cloud solutions, specifically in Azure.
• Experience with Azure cloud services, including Azure Data Factory, Gen 2, Azure Databases, Functions, Databricks, etc.
• Strong knowledge of Python, Java, or similar high-level server-side languages.
• Advanced SQL knowledge on relational databases, preferably MS SQL Server and Azure databases.
• Experience designing and architecting distributed systems, containerization, Web APIs, and gateway management.
• Experience with the DevOps lifecycle tools such as git and Jenkins.
• Experience with Jira and Confluence.
• Experience with REST web services and microservice architecture.
• Good understanding of ETL/ELT processes.
• Knowledge of Databricks Cluster configuration and Unity catalog repository setup.
• Ability to build large-scale batch and real-time data pipelines in Azure cloud.
• Minimum of 10+ years of software development experience in enterprise applications, preferably in financial services and data-heavy systems.
• Bachelor's or Master's degree in computer science or information systems preferred.

Nice to Have

• Experience in financial services industry.
• Experience with cloud migration projects.
• Experience with enterprise-grade data platforms and big data environments.

Qualifications

• 10+ years of software development experience in enterprise applications.
• Bachelor's or Master's degree in computer science or information systems (preferred).

Benefits & Perks

• Competitive salary range between $142,000 and $196,000, based on qualifications and experience.
• Potential eligibility for annual discretionary incentive awards.
• A portfolio of benefits offered to employees.
• Hybrid workforce model allowing work from home and office attendance.