Senior Software Engineer, Gemini Audio Inference - Mountain View

About the Role

Key Responsibilities

• Work with research teams to build the serving solution of Gemini models for different clients.
• Propose and test the best serving configurations based on client needs.
• Build new infrastructure to serve Gemini in different ways, such as streaming.
• Design and build audio-specific logic in the orchestration framework.
• Ensure the Gemini model quality in the production environment.
• Build and improve infrastructure to support streaming Gemini prompts at large scale.
• Bring Gemini Audio related capabilities to clients, e.g., Long Context capabilities to Meet and YouTube; Audio Out capabilities to Maps.
• Embrace a new orchestration infrastructure around Gemini model servings.

Requirements

• BS, MS or PhD degree in computer science, mathematics, applied stats, machine learning or similar.
• Experience working on software engineering projects from proof-of-concept through to implementation.
• Required programming languages: C++; Python a plus.
• Experience in performance engineering; GPU/TPU experience a plus.
• Great communication and interpersonal skills.
• Knowledge of machine learning and inference.
• Experience productionizing state-of-the-art large language and multimodal models is a plus.

Nice to Have

• Experience in performance engineering; GPU/TPU a plus.
• Experience in productionizing state-of-the-art large language and multimodal models a plus.

Qualifications

• BS, MS or PhD degree in relevant fields.

Benefits & Perks

• US base salary range between $166,000 - $244,000 plus bonus, equity, and benefits.