Staff, Data Engineer

About the Role

Key Responsibilities

• Design, build, and enhance high-performance reusable frameworks for data pipelines.
• Develop and deploy scalable data solutions impacting millions of customers worldwide to drive value from data at Walmart scale.
• Support international supply chain data applications ensuring data quality and governance standards.
• Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the technical community.
• Ensure data ingested and processed is accurate and of high quality by implementing data quality checks, validation, and cleaning processes.
• Analyze and translate business requirements into strategies, initiatives, and projects aligned with business objectives, and drive the execution of deliverables.
• Identify suitable data sources that are fit for purpose, including external sources as required.
• Build infrastructure for optimal data transformation and integration from various sources using appropriate technologies.
• Automate common data preparation and integration tasks using modern tools, techniques, and architectures.
• Provide guidance to stakeholders and team members on data governance practices.
• Collaborate with team members to solve business problems effectively.

Requirements

• Bachelor's or master's degree in computer science or a related field.
• 8+ years of experience in development of big data technologies and data pipelines.
• Proficiency in managing and manipulating datasets in the terabyte range.
• Expertise in big data frameworks such as Hadoop, Apache Spark, Apache Hive, preferably on cloud platforms like GCP, AWS, or Azure.
• Proven coding experience with Scala and Python.
• Experience building idempotent workflows using orchestrators like Airflow.
• Strong SQL skills for data analysis, optimization, and profiling, preferably in BigQuery or Spark SQL.
• Hands-on experience with messaging platforms like Kafka is preferred.
• Strong data modeling skills for designing adaptable schemas and facilitating data joins.
• Ability to work directly with stakeholders to understand data requirements and translate them into solutions.
• Strong analytical and problem-solving skills.
• Ability to work quickly with quality and deliver with minimal ramp-up time.
• Effective communication and collaboration skills.

Nice to Have

• Experience with ETL tools and working with large datasets in the cloud.
• Master's degree in Computer Science or related field with 4+ years of software engineering experience.
• Background in creating inclusive digital experiences and knowledge of Web Content Accessibility Guidelines (WCAG) 2.2 AA standards.
• Knowledge of accessibility best practices and assistive technologies.

Qualifications

• Option 1: Bachelor's degree in Computer Science and 4 years of experience in software engineering or related field.
• Option 2: 6 years of experience in software engineering or related field.
• Option 3: Master's degree in Computer Science and 2 years of experience in software engineering or related field.
• 3+ years of experience in data engineering, database engineering, business intelligence, or analytics.

Benefits & Perks

• Competitive salary with performance-based bonuses.
• Incentive awards for performance.
• 401(k) match, stock purchase plan.
• Paid maternity and parental leave.
• Paid time off including PTO, sick leave, holidays, and other leave options.
• Multiple health plans, short-term and long-term disability, life insurance.
• Additional perks such as company discounts, military leave pay, adoption and surrogacy expense reimbursement.
• Live Better U education benefit program covering tuition, books, and fees.