Sr. Lead AI Engineer (LLM Customization and Finetuning)

About the Role

Key Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to enhance performance metrics like scalability, cost, latency, and throughput of large-scale AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, Engineering, or AI plus at least 6 years of experience developing AI and ML algorithms or technologies, or Master's degree plus at least 4 years of experience in the same field.
• At least 6 years of programming experience with Python, Go, Scala, or Java.
• Experience designing, developing, and supporting complex AI systems, including LLM inference, similarity search, VectorDBs, guardrails, and memory.
• Strong foundation in engineering and mathematics, with expertise in hardware, software, and AI optimization opportunities.
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts clearly.

Nice to Have

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or private clouds.
• Experience leading and mentoring engineering teams and influencing cross-functional stakeholders.
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Master's degree in Computer Science, Computer Engineering, or relevant technical field.
• Demonstrated ability to stay abreast of the latest AI research and apply novel techniques in production.

Qualifications

• Bachelor's or Master's degree in a relevant technical field.
• Minimum 4-6 years of experience in AI/ML algorithm development or related technologies.
• Experience with cloud deployment and complex AI system support.

Benefits & Perks

• Competitive full-time annual salary based on location, with ranges up to $280,600.
• Performance-based incentive compensation, including cash bonuses and long-term incentives.
• Comprehensive health, financial, and other benefits supporting total well-being.
• Eligibility for sponsorship for employment authorization for qualified applicants.