Senior Data Engineer

About the Role

Key Responsibilities

• Design scalable and efficient SQL database architectures tailored to upstream, midstream, and downstream oil and gas operations.
• Develop and maintain logical and physical data models to support data warehousing and business reporting needs.
• Write complex T-SQL code including stored procedures, views, functions, and triggers.
• Optimize large-volume queries for production logs, telemetry, and field operations to improve performance and reliability.
• Build and manage robust ETL/ELT pipelines for structured and unstructured data from sources such as SCADA, historians, ERP systems (e.g., SAP), CMMS, drilling reports, and IoT devices.
• Ensure data validation, integrity, and transformation align with business and regulatory standards.
• Develop and manage Flyway-based SQL migration scripts to version control database changes.
• Integrate database deployment automation into CI/CD pipelines using tools like Azure DevOps or GitHub Actions.
• Ensure consistent deployment processes across development, test, staging, and production environments.
• Leverage Visual Studio and .NET tools to build supporting utilities or integrate with existing applications.
• Provide performant SQL backends for reporting platforms such as Power BI, Spotfire, or Tableau.
• Collaborate with data analysts, architects, and business stakeholders to translate operational requirements into scalable data solutions.
• Support application teams and business users during feature rollouts, deployments, and upgrades.
• Document database structures, processes, and technical design decisions.
• Enforce and advocate for SQL development best practices, code reviews, and maintainability standards.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
• 8+ years of experience in SQL development and database architecture.
• Strong command of Microsoft SQL Server, SSIS, and T-SQL.
• Experience in Oil & Gas domains (e.g., well lifecycle, production volumes, pipeline operations).
• Hands-on experience with Flyway for database versioning and change management.
• Proficiency in Visual Studio and custom software development tools.
• Familiarity with data modeling tools (ER/Studio, Erwin) and version control systems (Git).

Nice to Have

• Experience with cloud data platforms (Azure SQL, AWS RDS, Snowflake).
• Understanding of WITSML standards and Oil & Gas-specific data structures.
• Exposure to Python, PowerShell, or other scripting languages for data automation.
• Experience with data governance, MDM, and data quality frameworks.

Qualifications

• Minimum 9+ years experience in data engineering or related fields.