Sr Data Engineer

Stifel Financial

Memphis, TN

Full Time

Senior

18 days ago

Job Description

About the Role

The Sr Data Engineer at Stifel is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform. This role involves working with large volumes of data to ensure its quality, reliability, speed, and accessibility, enabling efficient data-driven decision-making within a company that values innovation, client focus, and a collaborative culture.

Key Responsibilities

Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in the AWS cloud environment.
Work closely with stakeholders to understand their data requirements and design data solutions that meet their needs.
Understand data models/schemas and implement ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destination.
Monitor and optimize the performance of data pipelines, troubleshoot issues, and ensure data quality and integrity.

Requirements

Extensive experience with enterprise data solutions, including data warehouse modernization, enterprise data lakes, cloud migration, automation, and reducing engineering toil.
Working experience with Amazon Well Architected Framework.
Proficient in programming languages such as Python and SQL for database querying and manipulation.
Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.
Knowledge of database design principles and experience with database management systems.
Experience with data storage technologies, such as relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark).
Understanding of ETL processes and experience with ETL tools like AWS Glue and SQL Server Integration Services.
Skilled at integrating disparate data sources and ensuring data quality and consistency.
Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions, and notification services.
Familiarity with Infrastructure as Code (IAC), such as Terraform, git, and DevOps pipelines.
Strong analytical thinking and problem-solving abilities.
Ability to analyze complex data sets, identify patterns, and derive actionable insights.
Awareness of data governance practices, data privacy regulations, and security protocols.
Experience implementing data security measures and ensuring compliance with relevant standards is desirable.
Passion for mentoring less experienced engineers.
Minimum of 10+ years of post-bachelor progressive experience in data engineering.
Bachelor's Degree in Computer Science, related field, or equivalent experience.

Nice to Have

Experience with data security measures and compliance standards.

Qualifications

Bachelor's Degree in Computer Science, related field, or equivalent experience.
10+ years of post-bachelor experience in data engineering.

Benefits & Perks

Comprehensive benefits package including health, dental, and vision care.
401k plan.
Wellness initiatives.
Life insurance.
Paid time off.

Working at Stifel Financial

Stifel strives for a culture that puts clients and associates first, fostering a welcoming environment where everyone belongs and contributes to collective success. The company values innovation, collaboration, and a start-up mindset despite its long history, emphasizing entrepreneurial spirit and continuous improvement.

Apply Now