Data Engineer Senior - Data and Automation (Oracle, Python, Hadoop, SQL, Unix/Linux)

About the Role

Key Responsibilities

• Act as an internal consultant for other data engineering and technical teams to enhance and optimize the quality of their code, ensuring adherence to engineering best practices.
• Describe business outcomes, data uses, data sources, and their management concepts and analytical approaches to all organizational levels in both business and technology.
• Develop approaches to solutions as part of a team; review architecture and identify areas for automation, optimization, right-sizing, and cost reduction to support health of the environment.
• Design, build and test data integration processes between business-critical applications to solve complex problems within financial services.
• Define and implement internal process improvements through the development of detailed analytics that provide actionable insights into key business performance metrics.
• Lead in developing, supporting and implementing data solutions for multiple applications to meet business objectives and user requirements.
• Lead data requirement analysis and the data preparation process development for targeted data solutions.
• Design and build data service infrastructure on multiple data platforms, according to the workflow.
• Oversee the development and implementation of data solutions for multiple applications to ensure scalability, availability, and maintainability.
• Consult on data migration and transformation to ensure data accuracy and security.

Requirements

• Extensive experience with big data technologies and distributed computing tools (Hadoop, Spark, Hive Kafka, etc.).
• Strong proficiency in relevant programming languages such as Python, PySpark, Spark, SQL.
• Practical development and application of GraphDB technologies (Neo4J).
• Strong background and practical experience in enterprise database systems (Oracle, Teradata, etc.).
• Proficient in Containerization (OpenShift, Kubernetes, Docker, etc.).
• Experience with public cloud platforms (prefer AWS and Microsoft Azure).
• Knowledge of Unix/Linux shell scripting.
• Typically requires a university/college degree with 5+ years of industry-relevant experience.

Nice to Have

• Analytical Thinking
• Data Analytics
• Data Mining
• Data Science
• Machine Learning
• Application Delivery Process
• Big Data Management and Analytics
• Business Intelligence
• Consulting
• Data Analysis - Software
• Data Architecture
• Database Structures
• Problem Solving
• Software Development Life Cycle

Qualifications

• Roles at this level typically require a university/college degree.
• 5+ years of industry-relevant experience.
• No specific certifications or licenses required.

Benefits & Perks

• Comprehensive range of benefits including medical/prescription drug coverage with HSA, dental and vision options.
• Employee and spouse/child life insurance; short and long-term disability protection.
• 401(k) with PNC match, pension and stock purchase plans.
• Dependent care reimbursement, back-up child/elder care, adoption, surrogacy, and doula reimbursement.
• Educational assistance, including fully paid programs.
• Robust wellness program with financial incentives.
• Paid time off including maternity/parental leave, holidays, vacation days, and occasional absence days.