Data Engineer

About the Role

Key Responsibilities

• Work with large, complex datasets and ensure efficient data processing and transformation.
• Collaborate with cross-functional teams to gather and understand data requirements.
• Ensure data quality, integrity, and security across all processes.
• Implement data validation, lineage, and governance strategies to ensure data accuracy and reliability.
• Build, optimize, and maintain ETL pipelines for structured and unstructured data, ensuring high throughput, low latency, and cost efficiency.
• Experience in building scalable, distributed data pipelines for processing real-time and historical data.
• Contribute to the architecture and design of data systems and solutions.
• Write and optimize SQL queries for data extraction, transformation, and loading (ETL).
• Advise Product Owners to identify and manage risks, debt, issues, and opportunities for technical improvement.
• Provide continuous improvement suggestions in internal code frameworks, best practices, and guidelines.
• Contribute to engineering innovations that support Maersk's vision and mission.

Requirements

• 4+ years of experience in data engineering or a related field.
• Strong problem-solving and analytical skills.
• Experience with Java and the Spring framework.
• Experience in building data processing pipelines using Apache Flink and Spark.
• Experience in distributed data lake environments (e.g., Dremio, Databricks, Google BigQuery).
• Experience with Apache Kafka and Kafka Streams.
• Experience working with databases, with solid SQL query optimization skills (PostgreSQL preferred).
• Hands-on experience in cloud environments such as Azure Cloud (preferred), AWS, or Google Cloud.
• Experience with data warehousing and ETL processes.
• Experience in designing and integrating data APIs (REST/GraphQL) for real-time and batch processing.
• Knowledge of Great Expectations, Apache Atlas, or DataHub is a plus.
• Knowledge of RBAC, encryption, GDPR compliance is a plus.
• Excellent communication and collaboration skills.
• Ability to translate between technical and business language and communicate effectively to different target groups.
• Ability to understand complex design.
• Ability to work independently and guide the team.
• Fact-based and result-oriented mindset.

Nice to Have

• Knowledge on Great Expectations, Apache Atlas, or DataHub.
• Knowledge on RBAC, encryption, GDPR compliance.