Senior Software Engineer

About the Role

Key Responsibilities

• Design, implement, and manage scalable data platforms, including data lakes and data warehouses, using cloud infrastructure and big data tools.
• Collaborate with the EDW team, Data Architects, DBAs, application team developers, and business stakeholders to deliver large-scale Big Data solutions.
• Create optimal design adhering to architectural best practices, considering scalability, reliability, and performance.
• Apply DevOps principles, take ownership of production success, optimize operations via automation, active alerting, and self-healing, and lead resolution of production issues to ensure high availability and performance.
• Develop high-quality code, define engineering best practices, perform peer code reviews, and ensure successful delivery with engineering excellence.
• Document engineering artifacts such as technical design documents, flowcharts, system context diagrams, and code comments.
• Drive release planning and execution with an end-to-end understanding of effort, risk, and priority of features.
• Work with Azure or other cloud platforms to ensure optimal performance, security, and cost-efficiency of cloud-based systems.
• Apply machine learning and AI technologies to software products and develop technical strategies for data solutions.
• Utilize orchestration tools such as Airflow to automate and manage data workflows.
• Implement and manage CI/CD pipelines using GitHub Actions to ensure smooth deployment processes.
• Collaborate cross-functionally with engineers, data scientists, and business teams to refine data models and improve data systems.

Requirements

• Bachelor's degree or equivalent work experience.
• Five to six years of relevant experience.
• Proficiency in building large-scale data integration solutions with Spark, Scala, and other programming languages.
• Experience with Python for data processing solutions.
• Proficiency in SQL and optimizing complex queries.
• Knowledge of data modeling and database design.
• Experience with Azure Synapse, Azure Open AI services, and Azure Synapse.
• Experience with orchestration tools such as Airflow.
• Understanding of GitHub Actions and CI/CD practices.
• Experience in system design focusing on building data lakes or data warehouses from scratch.
• Strong ability to construct data models within relational and non-relational databases.

Nice to Have

• Hands-on experience in data engineering or related roles for 7+ years.
• Experience in developing large-scale data integration solutions.
• Knowledge of cloud infrastructure and big data tools.
• Experience with data lakes, data warehouses, and cloud platforms like Azure.
• Familiarity with AI and machine learning applications in data solutions.

Benefits & Perks

• Healthcare (medical, dental, vision).
• Basic term and optional term life insurance.
• Short-term and long-term disability coverage.
• Pregnancy disability and parental leave.
• 401(k) and employer-funded retirement plan.
• Paid vacation (from two to five weeks depending on salary grade and tenure).
• Up to 11 paid holiday opportunities.
• Adoption assistance.
• Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per year.