Senior Software Engineer

About the Role

Key Responsibilities

• Design, implement, and manage scalable data platforms, including data lakes and data warehouses, using cloud infrastructure and big data tools.
• Collaborate with the EDW team, Data Architects, DBAs, application team developers, and business stakeholders to deliver large-scale Big Data solutions.
• Create optimal design adhering to architectural best practices, considering scalability, reliability, and performance.
• Apply Dev/Ops mindset, take ownership of production success, optimize operations via automation, active alerting, and self-healing, and lead resolution of production issues to ensure high availability and performance.
• Develop high-quality code, define engineering best practices, perform peer code reviews, and ensure successful deliverables with engineering excellence.
• Document engineering artifacts such as technical design documents, flowcharts, system context diagrams, and code comments.
• Drive release planning and execution with end-to-end understanding of effort, risk, and priority of features.
• Work with Azure or other cloud platforms to ensure optimal performance, security, and cost-efficiency of cloud-based systems.
• Apply machine learning and AI technologies to software products and develop technical strategies for data solutions.
• Utilize orchestration tools such as Airflow to automate and manage data workflows.
• Implement and manage CI/CD pipelines using GitHub Actions to ensure smooth deployment processes.
• Collaborate cross-functionally with engineers, data scientists, and business teams to refine data models and improve data systems.

Requirements

• Bachelor's degree or equivalent work experience.
• Five to six years of relevant experience.
• 7+ years of professional experience in data engineering or related roles.
• Hands-on experience in building large-scale data integration solutions with Spark, Scala, and other programming languages.
• Proficiency in Python for data processing solutions.
• Proficiency with SQL and the ability to optimize complex queries.
• Experience with data modeling and database design.
• Experience with Azure Synapse, Azure Open AI services, and Azure Synapse.
• Experience with orchestration tools such as Airflow.
• Knowledge of GitHub Actions and CI/CD practices.
• Experience in system design for building data lakes or data warehouses from scratch.
• Strong ability to construct data models and work within relational and non-relational databases.

Nice to Have

• Experience in system design with a focus on building data lakes or data warehouses from scratch.
• Strong ability to construct data models and work within relational and non-relational databases.

Qualifications

• Bachelor's degree or equivalent work experience
• Five to six years of relevant experience

Benefits & Perks

• Healthcare (medical, dental, vision)
• Basic term and optional term life insurance
• Short-term and long-term disability
• Pregnancy disability and parental leave
• 401(k) and employer-funded retirement plan
• Paid vacation (from two to five weeks depending on salary grade and tenure)
• Up to 11 paid holiday opportunities
• Adoption assistance
• Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per year