Senior Staff Software Engineer, ML Performance, TPU

Google

Mountain View, CA

Full Time

Senior

248k-349k

13 days ago

Job Description

About the Role

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. The role involves working on critical projects within the ML, Systems, & Cloud AI (MSCA) organization, which designs, implements, and manages hardware, software, machine learning, and systems infrastructure for all Google services and Google Cloud. The position emphasizes handling information at massive scale, extending beyond web search, and involves innovation across areas such as information retrieval, distributed computing, large-scale system design, networking, data storage, security, artificial intelligence, natural language processing, UI design, and mobile development.

Key Responsibilities

Identify and maintain Large Language Model (LLM) training and serve benchmarks that are representative to Google production.
Work on scaling numeric and algorithmic optimizations to Google products and ML models.
Work cross-functionally to solve LLM performance problems.
Analyze performance and efficiency metrics to identify bottlenecks, design, and implement solutions.

Requirements

Bachelor's degree or equivalent practical experience.
8 years of experience in software development, and with data structures/algorithms.
7 years of experience leading technical project strategy, ML design, and optimizing industry-scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
5 years of experience with one or more of the following: Speech/audio, reinforcement learning, ML infrastructure, or specialization in another ML field.
5 years of experience with design, architecture, and testing or launching software products.

Nice to Have

Master's degree or PhD in Engineering, Computer Science, or a related technical field.
5 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
Experience with ML development, modeling, optimization, and infrastructure.
Experience in ML compilers and run-times.
Experience in machine learning systems.

Qualifications

Formal educational background includes a Bachelor's degree or higher, with preferred qualifications of a Master's degree or PhD in a related field.

Benefits & Perks

US base salary range for this full-time position is $248,000-$349,000 plus bonus, equity, and benefits.
Benefits details available at https://careers.google.com/benefits/

Working at Google

Google is proud to be an equal opportunity workplace and is an affirmative action employer. The company is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. They also consider qualified applicants regardless of criminal histories, in accordance with legal requirements. Additional information is available at https://careers.google.com/eeo/ and https://careers.google.com/jobs/dist/legal/OFCCP_EEO_Post.pdf. The company emphasizes diversity, inclusion, and accessibility in its hiring practices.

Apply Now