Software Engineer III - Conversational AI

About the Role

Key Responsibilities

• Design, build, and improve capabilities in service-oriented architecture for exposing NLU capabilities at scale and enabling sophisticated model orchestration.
• Solve challenges related to service scalability and availability for traffic serving 80% of American households.
• Design and build primitives to efficiently orchestrate model-serving microservices, considering dependencies, latency, and robustness.
• Implement functionality to drive machine learning modeling and experimental design, including A/B testing.
• Guide efforts to optimize model serving architecture, tooling, and infrastructure to balance computational load, latency, and operational costs.
• Conduct load-testing to identify tradeoffs and tune the model-serving stack.
• Work on prompt engineering and agentic systems if interested.
• Author and maintain pipelines for building and deploying models via continuous deployment.
• Achieve scalable resource management in cloud infrastructure and provide diagnostics for quality control.
• Integrate or develop labeling tools for conversation data, interfacing with data stores like GCP and BigQuery.

Requirements

• 4+ years of experience in software engineering or related area.
• Solid data skills, sound computer-science fundamentals, and strong programming experience.
• Hands-on expertise in full-stack development.
• Programming experience with at least one modern language such as Scala, Java, C++, or C#.
• Experience with relational databases like MySQL, PostgreSQL, Oracle, or MS SQL.
• Some fluency in Python.
• Understanding of distributed data-processing at scale.
• Ability to handle ambiguous problems and think abstractly.
• Experience taking a project from scoping to launch.
• Drive to explore, improve, automate, and optimize systems and tools.
• Ability to apply scientific analysis and mathematical modeling to evaluate system designs.
• Excellent oral and written communication skills.
• Bachelor's degree in Computer Science, Engineering, Mathematics, or related field.

Nice to Have

• Experience with large-scale distributed systems, scalability, and fault tolerance.
• Experience leading the development of complex data-driven software systems.
• Focus on scalability, latency, performance, robustness, and cost trade-offs in cloud environments.
• Experience with cloud infrastructure such as OpenStack, Azure, GCP, or AWS, and infrastructure management tools like Docker and Kubernetes.
• Building and operating large data pipelines with big data technologies like Spark, Kafka, Cassandra, Hadoop, Hive, BigQuery, Presto, or Airflow.
• Hands-on expertise across front-end to back-end technologies.
• Familiarity with Machine Learning concepts and processes.
• Masters or PhD in Computer Science, Physics, Engineering, Math, or equivalent.

Qualifications

• Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 2 years' experience in software engineering or related area.
• Option 2: 4 years' experience in software engineering or related area.
• Preferred: Masters in Computer Science or related field.

Benefits & Perks

• Competitive salary ranging from $117,000 to $234,000 annually.
• Performance bonuses and additional compensation such as stock.
• Incentive awards for performance.
• Benefits including 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, health plans, life insurance, disability coverage, company discounts, military leave pay, adoption and surrogacy reimbursement, and more.
• Walmart-paid education benefit program Live Better U for associates.
• Paid time off for vacation, sick leave, holidays, and other purposes, meeting or exceeding legal requirements.