Principal, Software Engineer - MLE, People.AI

About the Role

Key Responsibilities

• Define and own the agentic architecture strategy across teams, including MasterAgent design, tool orchestration, memory layers, and dynamic router agents.
• Architect modular, testable, and composable Python systems that support multi-agent workflows, tool-chaining, RAG, memory management, and fallback strategies.
• Design LLM-powered execution engines that support both high throughput and adaptive reasoning using frameworks like LangChain, AutoGen, or custom solutions.
• Lead implementation of retrieval-augmented generation (RAG) pipelines, semantic search, and structured knowledge memory systems.
• Build and scale integrations with internal LLMs, including handling signature-based authentication, function calling, and context management at scale.
• Drive end-to-end lifecycle management from configuration schema (YAML) to execution trace logging, observability, and self-healing recovery patterns.
• Lead cross-organizational architecture reviews, influence roadmap prioritization, and set coding and design standards for agentic platform work.
• Mentor Staff and Senior engineers, build reusable libraries, and lead technical guilds around AI agent infrastructure.

Requirements

• 10+ years of professional software engineering experience, with 7+ years in Python, building distributed systems at scale.
• Deep knowledge of agentic design patterns, including ReAct, Plan-and-Execute, AutoGen-style coordination.
• Experience with tool calling, dynamic agent routing, and recursive agent planning.
• Expertise in building LLM-based systems with LangChain, OpenAI, Anthropic, or custom orchestrators.
• Hands-on experience with RAG pipelines using vector stores such as FAISS, Pinecone, Weaviate, Qdrant, or Azure Cognitive Search.
• Knowledge of LLM evaluation and observability techniques, including tracing, token usage, and agent state tracking.
• Experience with workflow orchestration using config-first approaches (YAML/JSON definitions, step runners).
• Strong background in distributed systems, task queues, asynchronous workflows, and backend performance optimization.
• Experience in cloud-native environments (AWS, GCP, or Azure), including containerization, monitoring, and secure API integrations.

Nice to Have

• Built or contributed to a custom agentic orchestration framework used across multiple product lines.
• Experience with vector search optimization, context ranking, or temporal memory solutions.
• Published talks, blogs, or papers on LLM systems, AI architecture, or applied reasoning frameworks.
• Deep understanding of applying LLM systems in regulated or high-compliance environments (PII handling, redaction, observability).
• Exposure to DevEx platforms for building workflows on top of intelligent agents.
• Familiarity with multi-modal agents (text + vision), LLM simulation patterns, or offline evaluation loops.

Qualifications

• Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years' experience in software engineering or related area.
• Option 2: 7 years' experience in software engineering or related area.
• Preferred: Master's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area.

Benefits & Perks

• Competitive pay with performance-based bonus awards.
• Health benefits including medical, vision, and dental coverage.
• Financial benefits such as 401(k), stock purchase, and company-paid life insurance.
• Paid time off including PTO, sick leave, parental leave, family care leave, bereavement, jury duty, and voting.
• Other benefits like short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement.
• PTO and PPTO for vacation, sick leave, holidays, or other purposes, with amounts depending on job classification and employment length.
• Live Better U education benefit program covering tuition, books, and fees for associates.