Software Developer

About the Role

Key Responsibilities

• Manage and scale daily runs of data pipelines on Databricks by ingesting data from Azure Synapse to Neo4J and manage access across different teams.
• Manage OpenAI endpoint logs across all instances for every project in multiple environments to manage costs and have alerting in place for over-the-limit API calls.
• Develop, maintain, and deploy Terraform Pipelines to create and decommission resources on Azure.
• Create Norm and Resolved layers to enhance data quality of graph data.
• Create models to help identify factors that contribute to potentially fraudulent activities in the insurance space.

Requirements

• Experience with data pipeline management and scaling, particularly on Databricks.
• Knowledge of managing API endpoints and monitoring logs, especially for AI services like OpenAI.
• Proficiency in developing and maintaining infrastructure using Terraform on Azure.
• Ability to create data models and improve data quality for graph data.
• Experience in identifying fraudulent activities through data modeling.

Nice to Have

• Experience working with Neo4J and graph databases.
• Knowledge of Azure Synapse and Azure resource management.
• Familiarity with insurance industry data and fraud detection techniques.

Qualifications

• Relevant experience in data engineering, platform management, or related fields.
• Proficiency with Databricks, Azure, Terraform, and graph data modeling.

Benefits & Perks

• Salary range of $100,000-$120,000 a year.