Senior Machine Learning Engineer, App Test

About the Role

Key Responsibilities

• Customize innovative AI solutions for our Test Automation systems, bridging the gap between general-purpose LLMs and the specialized requirements of Test Automation, encompassing areas from test case generation to intelligent reporting.
• Implement scalable AI/ML solutions for the automated testing of the Roblox App across all supported platforms, including mobile, desktop, console, and VR.
• Identify existing workflow and system inefficiencies that could benefit from AI integration.
• Drive innovation by exploring state-of-the-art ML research, including multimodal AI, LLMs, Reinforcement Learning, and Generative AI, and applying practical, impactful solutions for Test Automation.
• Provide mentorship to other engineers and contribute to the technical strategy across teams.
• Engage in effective collaboration with cross-functional partners, including engineers, product managers, and researchers throughout Roblox.

Requirements

• A minimum of three years of practical experience in designing, building, and deploying complex machine learning models into production environments at scale.
• A robust understanding and practical application of MLLMs and AI systems to resolve challenges in testing and test automation.
• Demonstrated mastery of deep learning frameworks (e.g., PyTorch, TensorFlow) and the ML development lifecycle.
• Strong programming skills, particularly in Python.
• A proactive, results-oriented approach to addressing ambiguous and challenging technical problems.
• Ability to successfully execute complex technical projects, make critical design decisions, influence technical roadmaps, and guide teams.

Nice to Have

• Experience in leveraging ML and AI models for automation and multi-platform testing.
• Experience in constructing and working with robust, cross-platform test automation frameworks.

Qualifications

• Experience in designing, building, and deploying machine learning models at scale.
• Practical application of MLLMs and AI systems for testing automation.
• Proficiency with deep learning frameworks such as PyTorch or TensorFlow.
• Strong programming skills in Python.

Benefits & Perks

• Annual salary range of $192,890—$238,520 USD.
• Eligibility for equity compensation and benefits.
• In-office work at the San Mateo, CA headquarters on Tuesday, Wednesday, and Thursday, with optional in-office days on Monday and Friday.