Data Engineer

About the Role

Key Responsibilities

• Oversee data lifecycle management, including data versioning, lineage tracking, quality assurance, and reporting.
• Design, build, and optimize robust and scalable data ingestion and labeling pipelines specifically for computer vision datasets.
• Manage and optimize data storage solutions to ensure efficient data retrieval and processing.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to project timelines.
• Collaborate closely with AI/ML Engineers and Researchers to understand their data needs and provide efficient data solutions.

Requirements

• Bachelor's in Computer Science, Data Engineering, or a related field, with 2+ years of professional experience as a Data Engineer.
• Strong Python and SQL; Good software development fundamentals.
• Demonstrated experience designing, building, and maintaining production-grade data pipelines.
• Proficiency with data modeling, ETL processes, data pipeline operations, and databases (e.g., Postgresql, Clickhouse).
• Excellent problem-solving skills and attention to detail.
• Strong communication skills and the ability to work effectively in a collaborative team environment.

Nice to Have

• Strong skills with data presentation tools, dashboards, and visualization such as Grafana, Plotly, Voxel51.
• Workflow orchestration tools, particularly Dagster.
• Experience with databases like Postgresql, Clickhouse.
• Automation tools and CI/CD pipelines and containerization technologies (e.g., Docker).
• Interest in aviation.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• 2+ years of professional experience as a Data Engineer.

Benefits & Perks

• Great medical, dental, orthodontic and vision insurance and a 24/7 counseling service.
• Free 24 Hour Fitness membership, access to all locations, onsite fitness classes, and free onsite bikes.
• Catered healthy food, social events, happy hours, and offsites.
• Funding for flight training up to $15,750 in fixed-wing aircraft or helicopters.
• Vacation: 5 weeks (25 days) in the first year, 6 weeks (30 days) after two years, plus 12 national holidays and unlimited sick days.