Data Scientist, AI Assurance - Level 3

About the Role

Key Responsibilities

• Train AI models and analyze internal model behaviors to uncover decision boundaries and data characteristics.
• Design and execute machine learning experiments following current best practices, including large-scale experiments on HPC systems.
• Evaluate AI systems across multiple axes, including performance metrics and generalization to out-of-distribution data.
• Assess empirical results to guide future research and experimental directions.
• Refactor, modularize, and optimize research code for maintainability and scalability.
• Build tools and APIs for seamless deployment and integration with unstructured code.
• Collaborate with researchers to understand algorithmic intent and with engineers to ensure system integration.
• Develop tools and APIs to enable integration into mission-relevant environments and workflows.

Requirements

• BS/BA and 5+ years of relevant work experience, or
• MS/MA and 3+ years of relevant work experience, or
• PhD with 1+ year of relevant experience.
• Proficiency with PyTorch and other deep learning libraries such as TensorFlow and Hugging Face.
• Ability to translate academic methods into deployable tools or workflows.
• Excellent communication and cross-functional collaboration skills.
• Familiarity with current ML research landscape, especially XAI, adversarial ML, AI safety, and deep learning.
• Hands-on experience analyzing internal structures of deep learning models, particularly LLMs and vision models.
• Experience in research engineering, ML engineering, AI systems integration, or applied data science.
• Strong proficiency in Python and experience with ML frameworks.

Nice to Have

• Interest in taking research prototypes to deployable tools for AI researchers.
• Experience with research codebases such as Jupyter notebooks and unstructured scripts.
• Ability to understand and implement algorithmic intent into production systems.

Qualifications

• Educational background as specified in requirements (BS, MS, or PhD).

Benefits & Perks

• Health insurance, dental insurance, vision insurance
• Health savings account, flexible spending accounts
• Basic life insurance, disability insurance
• Employee assistance program, business travel insurance
• Tuition assistance, parental bonding leave, surrogacy and adoption support, fertility support
• Company-funded pension plan and 401k savings plan
• Up to 120 vacation hours per year, ten paid holidays