Staff Software Engineer, Cloud TPU

About the Role

Key Responsibilities

• Identify and maintain LLM training and serving benchmarks representative of Google production, used by industry and ML community to identify performance opportunities and drive TensorFlow/JAX TPU performance.
• Work on scaling numeric and algorithmic optimizations to Google products and ML models, including techniques like quantization, sparsity, model compression, and new ML model architectures or training techniques.
• Collaborate cross-functionally to solve LLM performance problems, such as onboarding new LLM models and products on Google TPU hardware and enabling large-scale training on thousands of TPUs.
• Analyze performance and efficiency metrics to identify bottlenecks and design and implement solutions at scale.

Requirements

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development, with data structures/algorithms.
• 5 years of experience testing and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure, including model deployment, evaluation, data processing, debugging, and fine-tuning.
• 5 years of experience with embedded systems, lower-level software stacks (e.g., networking, storage), ML infrastructure, or compilers (e.g., XLA), or specialization in another ML field.

Nice to Have

• Master's degree or PhD in Engineering, Computer Science, or a related technical field.
• 3 years of experience working in a matrixed organization involving cross-functional or cross-business projects.
• 3 years of experience in a technical leadership role leading project teams and setting technical direction.
• Experience with performance analysis and optimization such as system architecture or performance modeling.
• Experience with machine learning systems, including background theory, TensorFlow, and other tools.
• Experience with compiler optimizations or related fields.

Qualifications

• Bachelor's degree or equivalent practical experience.

Benefits & Perks

• US base salary range for this full-time position is $197,000-$291,000 plus bonus, equity, and benefits.
• Salary ranges are determined by role, level, and location, with individual pay influenced by work location, skills, experience, and education.
• Additional benefits include bonus, equity, and other perks as outlined by Google.