Senior Data Engineer

About the Role

Key Responsibilities

• Design, develop, test, and implement data ingestion pipelines for large data sets utilized for analytics and data science activities.
• Utilize existing patterns and processes to ingest evaluation data sets at scale.
• Integrate additional technologies and solutions into the ingestion pipelines to provide the ability to augment and enhance the ingested data for analytics and data science models.
• Work with business and technology stakeholders to optimize information collection and storage aligned to business requirements and technology standards.
• Recommend improvements and apply standards, processes and procedures for big data processing.
• Design, develop, test and implement services to allow business stakeholders to interact with curated data sets through defined functional capabilities.
• Create and implement effective metrics and monitoring processes.
• Seek continuous performance improvement and ensure security of information at scale.
• Follow secure code standards and best practices to develop and deliver solutions supporting needed business functionality.
• Maintain Knowledge Management to communicate the best practices, standards, patterns, and other documentation which will facilitate operational support and user interaction with data ingestion pipelines.
• May lead small projects with manageable risk and resource requirements.
• Act as a resource and impact on the quality of work for colleagues with less experience.
• Perform other duties as assigned.

Requirements

• Bachelor's degree in arts/sciences (BA/BS) or equivalent education.
• 4+ Years big data or relevant experience required.
• 4+ Years' experience with cataloging, modeling, ingestion, processing, and streaming technologies and processes.
• Experience with Continuous Integration Tools (e.g., Jenkins, Cruise Control, Continuum, Travis).
• 1+ Years Data Analysis experience required.
• Development technologies (e.g., Python, Scala, Java).
• AWS technologies (e.g., Lambda, Step Functions, S3, Glue, EMR, IAM, Network, CloudWatch).
• Infrastructure as Code technologies (e.g., Terraform, CloudFormation).
• Database technologies (e.g., Snowflake, RDS, RedShift, Postgres, MongoDB, Athena, DynamoDB, MySQL, Oracle, NoSQL).
• JavaScript technologies (e.g., jQuery, Angular, React, Node.js).
• Communication and Data Exchange technologies (e.g., HTTP, SSL/TLS, REST, SQL, JSON).
• Enterprise Application Development technologies (e.g., AIX/Linux, Websphere, Weblogic, Tomcat, JBOSS).
• Test Driven Development processes and tooling (e.g., PyTest, JUnit, Mocha, Jasmine, Protractor).
• DevOps-style deployment tools (e.g., Docker, Ansible, Vagrant).
• Excellent verbal and written communication skills.

Nice to Have

• Master's degree in arts/sciences (MA/MS) preferred.

Qualifications

• Bachelor's degree in arts/sciences (BA/BS) or equivalent education.
• 4+ Years of big data or relevant experience.
• 1+ Years of Data Analysis experience.

Benefits & Perks

• Annual salary range of $87,050.00 - $131,450.00, depending on experience and location.
• Annual bonus plan and eligibility for long-term equity incentive plan.
• Full range of health, retirement, and other employee benefits.
• Opportunity to gain valuable knowledge and experience with diverse, caring colleagues worldwide.
• Respectful, welcoming environment fostering individuality and pioneering thought.
• Vast, endless career potential.