Principal Product Manager

Arm Holdings

San Jose, CA

Full Time

Senior

204k-276k

25 days ago

Job Description

About the Role

Arm is seeking a Product Manager for AI & Machine Learning to drive the development and adoption of AI-optimized solutions across Arm-based CPUs, NPUs, and GPUs. This role will focus on defining AI acceleration strategies, optimizing AI software frameworks for Arm hardware, and expanding ecosystem engagement. As a Product Manager, you will shape Arm's AI roadmap, work closely with engineering teams, and engage with partners such as cloud providers, OEMs, hyperscalers, and AI framework developers to enhance AI performance on Arm architecture.

Key Responsibilities

Define the AI acceleration roadmap across Arm's compute portfolio (CPU, GPU, NPU).
Drive AI/ML software optimization for TensorFlow, PyTorch, ONNX, and TVM on Arm-based chips.
Identify AI market trends, customer difficulties, and competitor strategies to refine product positioning.
Work with hyperscalers (AWS, Google, Microsoft), OEMs, and AI startups to drive adoption of Arm's AI technology.
Collaborate with engineering teams to optimize AI workloads for low-power inference and high-performance AI acceleration.
Support developer relations, SDK/API improvements, and open-source initiatives to expand Arm's AI influence.

Requirements

5-10+ years of product management experience in AI/ML, semiconductor, or software-hardware co-design.
Strong AI/ML knowledge, including AI inference optimization, neural network quantization, and hardware acceleration.
Experience in AI frameworks (TensorFlow, PyTorch, ONNX, TVM, MLIR) and their optimization for custom silicon.
Familiarity with low-power AI workloads, edge AI, or cloud AI infrastructure.
Experience engaging with hyperscalers, OEMs, and AI software developers to drive product adoption.
Strong technical acuity with the ability to collaborate across engineering, marketing, and sales teams.

Nice to Have

Master's or PhD in Computer Science, AI/ML, or Electrical Engineering.
Experience in semiconductor AI acceleration (e.g., NPUs, AI-optimized CPUs/GPUs).
Background in AI compilers, LLVM, MLIR, and AI-specific software stacks.

Qualifications

Educational background in Computer Science, AI/ML, or Electrical Engineering (preferred).

Benefits & Perks

Salary range of $204,000-$276,000 per year.
Competitive and equitable compensation package.
Support for accommodations during the recruitment process.
Flexible hybrid working environment tailored to team needs.

Working at Arm Holdings

Arm values individuals and aims to build extraordinary teams. The company emphasizes diversity, mutual respect, and equal opportunity. It fosters a work environment that supports both high performance and personal wellbeing, with flexible hybrid working arrangements and a commitment to inclusivity and accessibility.

Apply Now