Software Engineer, Systems ML - Frameworks / Compilers / Kernels

Job Description

About the Role

In this role, you will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the industry-leading PyTorch AI framework organization. The MTIA Software Team has been developing a comprehensive AI Compiler strategy that delivers a highly flexible platform to train and serve new deep learning/model architectures, combined with auto-tuned high performance for production environments across specialized hardware architectures. You will work on core areas such as PyTorch framework components, AI compiler and runtime, high-performance kernels, and tooling to accelerate machine learning workloads on current and next-generation MTIA AI hardware platforms. You will collaborate with AI researchers and hardware design teams to analyze models, develop compiler optimizations, and drive next-generation hardware-software co-design for AI applications.

Key Responsibilities

Development of software stack with a focus on AI frameworks, compiler stack, high-performance kernel development, and acceleration onto next-generation hardware architectures.
Contribute to the development of PyTorch AI framework core compilers to support new AI hardware accelerators and optimize their performance.
Analyze deep learning networks, develop and implement compiler optimization algorithms.
Collaborate with AI research scientists to accelerate the next generation of deep learning models such as Recommendation systems, Generative AI, Computer vision, NLP, etc.
Perform performance tuning and optimizations of deep learning framework and software components.

Requirements

Proven C/C++ programming skills.
Currently has, or is in the process of obtaining, a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.
Experience in AI framework development or accelerating deep learning models on hardware architectures.
Knowledge of GPU, CPU, or AI hardware accelerator architectures.
Experience working with frameworks like PyTorch, Caffe2, TensorFlow, ONNX, TensorRT.
Experience with AI high performance kernels: CUDA programming, OpenMP / OpenCL programming, or AI hardware accelerator kernel programming.
Experience in accelerating libraries on AI hardware such as cuBLAS, cuDNN, CUTLASS, HIP, ROCm.
Experience with compiler optimizations such as loop optimizations, vectorization, parallelization, hardware-specific optimizations like SIMD.
Experience with MLIR, LLVM, IREE, XLA, TVM, Halide is a plus.
Experience in developing training and inference framework components.
Experience in system performance optimizations including runtime analysis of latency, memory bandwidth, I/O access, compute utilization analysis, and tooling development.

Nice to Have

Experience with MLIR, LLVM, IREE, XLA, TVM, Halide.

Qualifications

A Bachelor's degree in Computer Science, Computer Engineering, or relevant technical field and 4+ years of experience in AI framework development or accelerating deep learning models on hardware architectures.
Or a Master's degree in Computer Science, Computer Engineering, or relevant technical field and 2+ years of experience.
Or a PhD in Computer Science, Computer Engineering, or relevant technical field.

Apply Now