Data Engineer Hybrid- multiple locations (DFW area, Central Florida, King of Prussia, PA, Stratford, CT, Denver, Marietta, GA)

Calance

King of Prussia, PA

Full Time

Senior

10 days ago

Job Description

About the Role

As a Data Engineer, you will be responsible for the development, optimization, and management of data ingestion, transformation, and storage processes using modern frameworks. The successful candidate will implement infrastructure-as-code and automation solutions to streamline and build resiliency into data processing workflows. You will work closely with our data science and analytics teams to create and optimize data and machine learning models that support stakeholder needs.

Key Responsibilities

Design, build, and maintain large-scale data systems, including data warehouses, data lakes, and data pipelines
Develop and implement data architectures that meet the needs of our business stakeholders
Collaborate with data scientists and analysts to develop and deploy machine learning models and data products
Ensure data quality, security, and compliance with standards
Develop and maintain technical documentation of data systems and architectures
Troubleshoot and resolve data-related issues and optimize system performance
Develop and implement automated testing and deployment scripts to ensure smooth and efficient delivery of data solutions
Collaborate with cross-functional teams to identify and prioritize data requirements and develop solutions to meet business needs

Requirements

US Citizenship is required for this role
Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent combination of education and experience)
7+ years of experience in data engineering, software development, or a related field
Strong programming skills in languages such as Python and Terraform
Strong understanding of data architecture, data modeling, and data warehousing concepts
Experience with data pipeline tools such as Apache Spark, Apache Kafka, AWS Kinesis
Experience with Artificial Intelligence and Machine Learning technologies
Strong understanding of data security and compliance principles and practices
Excellent problem-solving skills, with the ability to analyze complex data systems and identify areas for improvement
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams

Nice to Have

Experience with cloud-based data platforms such as AWS and Azure
Experience with agile development methodologies and version control systems such as Git
Experience with data visualization tools such as Tableau and Cognos Analytics
Familiarity with complex data regulatory requirements such as NIST 800-171 and SOX
Familiarity with OpenTelemetry standards
Experience with optimization for observability data and real-time anomaly detections

Apply Now