Online Senior Data Engineer

The Home Depot

Atlanta, GA

Full Time

Senior

23 days ago

Job Description

About the Role

The Online Data Engineer team at The Home Depot is responsible for translating business requirements into infrastructure that captures and transforms customer data. They acquire datasets, develop algorithms, build and maintain database pipelines, create data validation and analysis tools, and develop APIs to retrieve data. The role involves developing, hosting, and maintaining enterprise solutions to improve reliability through monitoring, testing, and validation. Data Engineers use big-data techniques to cleanse, organize, and transform data, ensuring data structures and integrity are maintained automatically. The Sr Data Engineer establishes design standards and assurance processes for software, systems, and applications development, reviewing data operations and suggesting system upgrades to meet ongoing needs.

Key Responsibilities

Leverage extensive business knowledge into solution approach; develop trust and collaboration with internal customers and cross-functional teams; provide education on advanced analytics to technical and non-technical partners; seek new business opportunities to leverage data science as a competitive advantage.
Work with project teams and business partners to determine project goals; provide direction on prioritization and quality; mentor and coach junior team members; collaborate on workload and resource distribution; support recruiting and hiring efforts.
Execute tasks efficiently and with high quality; select, interpret, and utilize advanced analytical methodologies; communicate insights and recommendations to technical and non-technical leaders; prepare reports, updates, and presentations; communicate impacts of recommendations to drive alignment and implementation.
Guide project teams in requirements gathering, design, and development of complex applications; seek knowledge on developments within analytics, technical skills, and data sources; participate in improving predictive and prescriptive analytics by developing replicable solutions.

Requirements

Must be 18 years of age or older.
Must be legally permitted to work in the United States.
4 years of relevant work experience.
Demonstrated experience in predictive modeling, data mining, and data analysis.
Experience in generating content using Large Language Models.
Experience developing and testing ETL jobs/pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting pipelines in production.
Proficiency in high-level programming languages such as Python.
Experience defining and capturing metadata and rules for ETL processes.
Experience building Batch and Streaming pipelines.
Experience writing analytical SQL queries and performance-tuning queries.
Ability to stitch and maintain data from multiple sources.
Ability to produce tags for site data.
Proficiency in Python, Google BigQuery, PySpark, AirFlow, and DataProc for data engineering and automation.
Ability to optimize pipeline runtime and reduce costs on slots/storage.
Ability to prioritize requests and manage a product roadmap.
Experience coaching junior engineers on code, best practices, and data engineering principles.

Nice to Have

Demonstrated experience in predictive modeling, data mining, and data analysis.
2+ years of Search Engine Optimization work experience.
Experience in generating content using Large Language Models.
Experience in developing and testing ETL jobs/pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting pipelines in production.
Experience in high-level programming languages such as Python.
Experience defining and capturing metadata and rules associated with ETL processes.
Experience building Batch and Streaming pipelines.
Prior direct experience writing analytical SQL queries and performance-tuning queries.
Ability to stitch and maintain data from multiple sources.
Ability to produce tags for site data.
Proficiency with PySpark, AirFlow, DataProc, and Google BigQuery.
Ability to optimize pipeline runtime and lower costs.
Experience managing a product roadmap.
Coaching skills for junior engineers.

Qualifications

Bachelor's degree or equivalent in a related field.
Master's degree or equivalent preferred.

Benefits & Perks

Not specified in the description.

Working at The Home Depot

The description emphasizes collaboration, action orientation, driving engagement and results, effective communication, customer focus, managing conflict, and a focus on continuous improvement and technical excellence.

Apply Now