ML Ops Engineer

Insight Global

Baltimore, MD

Full Time

Senior

140k-150k

8 days ago

Job Description

About the Role

Insight Global is actively hiring a ML Ops Engineer in support of a newly awarded Government Program in Woodlawn Maryland. The selected candidate will work on a team responsible for automating and deploying ML models into a production environment. The company is committed to creating inclusive environments where people can bring their full, authentic selves to work every day and is an equal opportunity employer.

Key Responsibilities

Automate and deploy machine learning models into a production environment.
Manage and deploy custom-built applications with limited to no use of Docker containers.
Work on the ML development lifecycle including labeling, training, testing, deployment, and monitoring.
Manage ML model performance, including memory management and debugging.
Build, deploy, and maintain infrastructure and pipelines for large language models (LLMs).
Integrate prompt management into pipelines and address challenges such as token usage, cost, and hallucination rates.

Requirements

Masters +5 years of experience or Bachelor's Degree + 7 years of experience.
Understanding of ML development lifecycle (labeling, training, testing, deployment, monitoring).
Experience deploying high throughput ML models to a production environment.
Expertise in Python and dev/test/prod deployment pipelines.
Proficiency in Java, SQL (PostgreSQL), NoSQL (MongoDB), regular expressions, and version control (Git).
Experience managing ML model performance, including memory management and debugging.
Experience with ML frameworks such as Tensorflow, Pytorch, ONNX, Scikit-Learn, Pandas, Keras, Tesseract, Sagemaker, AWS.
Knowledge of NLP and ML concepts including BERT, CNN, RNN, SVMs, ensemble methods, clustering, transformers, and more.
Experience with NLP preprocessing, pattern recognition, feature extraction, and various learning techniques.
Experience building, deploying, and maintaining infrastructure and pipelines for LLMs, including prompt management and understanding challenges like token usage and hallucination rates.

Nice to Have

Experience with open source libraries for NLP and emerging approaches.
Knowledge of semantic parsing, information extraction, and advanced NLP techniques.

Qualifications

Master's degree with over 5 years of experience or Bachelor's degree with over 7 years of experience.

Benefits & Perks

Salary range of $140,000 - $150,000 depending on experience.

Working at Insight Global

Insight Global is committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. They are an equal employment opportunity/affirmative action employer that believes everyone matters.

Apply Now