Senior Applied Research Engineer - Multimodal Reasoning, SIML

Apple

Full Time

Senior

181k-318k

12 days ago

Job Description

About the Role

The Senior Applied Research Engineer - Multimodal Reasoning at Apple is a role within the Scene Understanding team that focuses on transforming cutting-edge research into compelling user experiences through Apple Intelligence technologies. The team works on multimodal machine learning systems such as Image Playground, Genmoji, Generative Memories, Semantic Search, and more, with an emphasis on scaling ML workflows, optimizing models for on-device experiences, and advancing multimodal capabilities of large language models. The role involves leading cross-functional efforts in ML modeling, prototyping, validation, and private learning to enhance user interactions with devices and communication methods.

Key Responsibilities

Training large-scale multimodal (2D/3D vision-language) models on distributed backends.
Deploying compact neural architectures efficiently on device.
Learning personalized policies that preserve user privacy.
Ensuring model quality in real-world scenarios with a focus on fairness and robustness.
Collaborating closely with ML researchers, software engineers, hardware, and design teams.
Enriching multimodal capabilities of large language models, especially aligning image/video content with visual actions and multi-turn interactions.

Requirements

M.S. or PhD in Computer Science, Electrical Engineering, Robotics, Statistics, Applied Mathematics, or related field, or equivalent experience.
5+ years of industry experience working at the intersection of NLP and Vision machine learning.
Proven hands-on experience training LLMs and adapting pre-trained LLMs for downstream tasks and alignment.
Proficiency in ML toolkit of choice, e.g., PyTorch.
Strong programming skills in Python.

Nice to Have

Familiarity with distributed training.
Strong programming skills in C/C++ or Objective-C.

Qualifications

Educational background as specified in the requirements (M.S. or PhD or equivalent experience).

Benefits & Perks

Comprehensive medical and dental coverage.
Retirement benefits.
Range of discounted products and free services.
Reimbursement for educational expenses.
Discretionary bonuses or commission payments.
Relocation assistance.
Opportunity to participate in Apple's employee stock programs.

Working at Apple

Apple is an equal opportunity employer committed to inclusion and diversity, promoting equal opportunity for all applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other protected characteristics.

Apply Now