Senior Machine Learning Engineer, Recipe Pathfinding

Nvidia

Redmond, WA

Full Time

Senior

184k-288k

14 days ago

Job Description

About the Role

NVIDIA is seeking a Senior Machine Learning software engineer to discover and innovate new low-precision and sparsity recipes in the pretraining setting. We are a team committed to developing next-generation software to make use of novel hardware features on current GPUs. We also provide guidance for design of next-gen GPU features. The job scope spans recipe design for all phases of the LLM life cycle: pre training, post training, and generation. Making these recipes generic and accurate is critical for adoption. Your work will be a component of our SW productization story in libraries like Megatron-LM, Transformer Engine, cuDNN, cuBLAS, etc.

Key Responsibilities

Keep abreast on quantized LLM training research
Build robust and reproducible training recipes
Collaborate closely with hardware, software, and research teams to assess and adopt deep learning algorithmic advancements in quantization
Work with production software teams to realize recipes in production workflows

Requirements

PhD, M.S. degree or equivalent experience in Computer Science or a related field, and 5+ years of relevant software engineering experience
Proficient in Python
Experience with PyTorch or similar framework
Solid foundation in LLM pre training, post training, or generation
Proficient in the math of machine learning
Strong written and oral communication skills

Nice to Have

Proficient in precision and numerics for ML
Familiarity with FP8 and MX formats for training
Strong programming skills and ability to debug ML systems

Qualifications

Relevant experience in computer science or related field
Experience with deep learning frameworks and GPU-based ML systems

Benefits & Perks

Base salary range of 184,000 USD - 287,500 USD, determined based on location, experience, and similar positions
Eligibility for equity and benefits

Working at Nvidia

Widely considered to be one of the technology world's most desirable employers, NVIDIA has some of the most forward-thinking and hardworking people in the world inventing the future. NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer, valuing diversity in current and future employees.

Apply Now