Data Engineer, Financial Data Engineering

About the Role

Key Responsibilities

• Design, develop, test, troubleshoot, and optimize solutions created to simplify access to American Express's Big Data Platform.
• Partner with multiple tech and product teams to craft enterprise-scale technical product requirements and deliver public cloud services.
• Analyze, debug, and fix Apache Beam and Flink data pipelines for orchestration, quality, and performance.
• Implement cloud platform solutions using innovative technologies and industry-standard processes, with a focus on Google Cloud.
• Design and implement robust data engineering pipelines for ETL and ELT workflows.
• Optimize data engineering processes for scalability, reliability, and performance.
• Create engineering best practices and tools that become integral to platform operations.
• Drive consensus and tangible outcomes through collaboration and effective communication with internal and external partners.

Requirements

• Up to 4+ years of data engineering software development experience in a professional environment or comparable experience.
• Bachelor’s degree in computer science, computer engineering, or equivalent.
• Hands-on expertise with application design, software development, and automated testing.
• Experience in deploying enterprise-grade technology products in an Agile environment.
• Large scale software product engineering experience with tools and delivery methods such as DevOps, CD/CI, Agile.
• Hands-on experience with in-memory frameworks and components like Java/J2EE, NodeJS, Python, Big Data Technologies, Apache Flink, Apache Beam, SingleStore, No-SQL Databases, Relational Databases, JSON, XML, REST, Kafka.
• Experience with jobs orchestration tools such as Airflow and Automic.
• Expertise in designing and implementing data engineering pipelines for ETL and ELT workflows.
• Proficiency in data engineering best practices for data ingestion, transformation, and orchestration.
• Strong understanding of data partitioning, sharding, schema evolution, and data quality, lineage, and governance.
• Hands-on experience with cloud-based data engineering platforms like AWS Glue, GCP Dataflow, Azure Data Factory.
• Highly proficient in SQL and PL/SQL.
• Experience in developing high-performance APIs and microservices using multiple architectural and design patterns.
• Excellent collaboration and communication skills.

Nice to Have

• Knowledgeable and experienced with in-memory computation and data virtualization tools & techniques.
• Experience in data engineering of financial data.
• Knowledge of GCP, Kubernetes, and Docker.
• Experience with memory-first databases like SingleStore.
• Experience with DevOps tools, automating engineering and operational tasks.

Qualifications

• Bachelor’s degree in computer science, computer engineering, or equivalent.

Benefits & Perks

• Competitive base salaries and bonus incentives.
• 6% Company Match on retirement savings plan.
• Free financial coaching and financial well-being support.
• Comprehensive medical, dental, vision, life insurance, and disability benefits.
• Flexible working model with hybrid, onsite, or virtual arrangements.
• 20+ weeks paid parental leave for all parents.
• Free access to global on-site wellness centers (depending on location).
• Free and confidential counseling support through our Healthy Minds program.
• Career development and training opportunities.