Data Scientist, AI Assurance - Level 3

About the Role

Key Responsibilities

• Train AI models and analyze internal model behaviors to uncover decision boundaries and data characteristics.
• Design and execute machine learning experiments following community best practices, including large-scale experiments on HPC systems.
• Evaluate AI systems across multiple axes, including performance metrics and generalization to out-of-distribution settings.
• Assess empirical results to guide future research and experimental steps.
• Refactor, modularize, and optimize research code for maintainability and scalability.
• Build tools and APIs for seamless deployment and working with unstructured code.
• Collaborate with researchers to understand algorithmic intent and with engineers to ensure integration into broader systems.
• Develop tools and APIs to enable integration into mission-relevant environments and workflows.

Requirements

• BS/BA and 5+ years of relevant work experience, or MS/MA and 3+ years of relevant work experience, or PhD with 1+ year of relevant experience.
• Ability to write high-quality, documented code for research methods or deployment.
• Proficiency with PyTorch and other deep learning libraries such as TensorFlow and Hugging Face.
• Excellent communication and cross-functional collaboration skills.
• Familiarity with current ML research landscape, especially XAI, adversarial ML, AI safety, and deep learning.
• Interest in translating research prototypes into deployable tools for AI research.
• Hands-on experience analyzing internal structures of deep learning models, particularly LLMs and vision models.
• Ability to understand and work with research codebases like Jupyter notebooks and unstructured scripts.
• Must be a U.S. citizen and able to obtain and maintain a federal security clearance.

Nice to Have

• Ability to translate academic methods into deployable tools or workflows to address critical challenges.
• Strong proficiency with TensorFlow and Hugging Face libraries.
• Experience in research engineering, ML engineering, AI systems integration, or applied data science.

Qualifications

• Educational background of BS/BA, MS/MA, or PhD as specified in requirements.

Benefits & Perks

• Health insurance, dental insurance, vision insurance, and health savings accounts.
• Flexible spending accounts, basic life insurance, disability insurance, and employee assistance programs.
• Business travel insurance, tuition assistance, parental bonding leave, surrogacy and adoption assistance, and fertility support.
• Automatic enrollment in company-funded pension plan and optional 401k plan.
• Up to 120 vacation hours per year and ten paid holidays.