Data Engineer
Verisk
Job Description
About the Role
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data pipeline architecture. The ideal candidate is an experienced data pipeline builder and data wrangler with strong experience in handling data at scale. The Data Engineer will support our software developers, data analysts, and data scientists on various data initiatives. This is a role that can be based in our Jersey City, NJ location (hybrid) or that can be done fully remote in the continental US (some locations not supported); work is on Eastern time zone hours. Why this role: This is a highly visible role within the enterprise data lake team. Working within our Data group and business analysts, you will be responsible for leading creation of data architecture that produces our data assets to enable our data platform. This role requires working closely with business leaders, architects, engineers, data scientists, and a wide range of stakeholders throughout the organization to build and execute our strategic data architecture vision.
Key Responsibilities
- Expand and optimize data pipeline architecture to support data initiatives.
- Support software developers, data analysts, and data scientists with data needs.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from various sources using SQL and AWS technologies.
- Design and implement data ETL frameworks for secured Data Lake, creating and maintaining an optimal pipeline architecture.
- Examine complex data to optimize efficiency and quality, resolve data quality problems, and collaborate with database developers to improve systems and database designs.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business metrics.
- Work with data scientists and industry leaders to understand data needs and design appropriate data models.
- Participate in the design and development of the AWS-based data platform and data analytics.
Requirements
- 3-5 years of full-time software engineering experience with at least 2 years in an AWS environment focused on application development.
- Extensive understanding of SQL queries and ability to fine-tune queries based on RDBMS performance parameters.
- Experience with building data applications using AWS Glue, Lake Formation, Athena, AWS Batch, AWS Lambda, Python, Linux shell, and Batch scripting.
- Hands-on experience with AWS Database services such as Redshift, RDS, DynamoDB, Aurora.
- Experience in writing advanced SQL scripts involving self joins, windows functions, correlated subqueries, CTEs, etc.
- Understanding of data management fundamentals, including data dictionaries, data models, validation, and reporting.
- Bachelor's degree or foreign equivalent in Computer Science, Software Engineering, or related field.
Nice to Have
- Experience working with data at scale.
- Strong collaboration skills with cross-functional teams.
- Knowledge of data architecture and strategic data platform development.
Qualifications
- Bachelor's degree or foreign equivalent in Computer Science, Software Engineering, or related field.
Job Details
Job Skills
Key skills identified from this job posting
Sign upto access all insights for this job
About Verisk
Website
verisk.com
Company Size
5001-10000 employees
Location
Jersey City, NJ
Industry
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
Similar Jobs
Other opportunities you might be interested in
Data Analytics Engineer
Actalent
Senior Vice President - Commercial Health Analytics
Aon
Master Data Management - Manager - Consulting - Location Open
Ernst & Young
Lead Analytics & Insights Associate - Operational Database
Vizient
Lead Analytics & Insights Associate - Operational Database
Vizient
Lead Analytics & Insights Associate - Operational Database
Vizient