Sr Data Engineer

Orion Innovation

Orlando, FL

Full Time

Senior

8 days ago

Job Description

About the Role

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Key Responsibilities

Design and optimize scalable ETL pipelines using Azure Synapse, Apache Spark, and AI Document Intelligence.
Perform PDF ingestion and parsing using prebuilt Document Intelligence models.
Tune Spark jobs, manage Serverless Pools, and orchestrate Synapse pipelines with schema drift handling.
Implement secure data flows utilizing Private Endpoints, Azure Key Vault, and managed security practices.
Apply Medallion Architecture principles, with typed data modeling in the Silver layer.
Monitor failures, set up alerting, and handle parallelized data ingestion.
Build robust, production-ready solutions integrating AI, big data, and cloud security on Azure.

Requirements

Expertise in Azure Synapse, Apache Spark, and AI Document Intelligence.
Hands-on experience with PDF ingestion and parsing using Document Intelligence models.
Strong skills in Spark job tuning, Serverless Pools, and Synapse pipeline orchestration.
Experience with Private Endpoints, Azure Key Vault, and security practices for data flows.
Knowledge of Medallion Architecture and typed data modeling.
Ability to build scalable, reliable data solutions on Azure with monitoring and alerting capabilities.