Sr Software Developer - AI DevOps Engineer

About the Role

Key Responsibilities

• Deploy and scale ML applications and models using Kubernetes (K8s) and lightweight K3s clusters, optimizing for our AI accelerator chips.
• Containerize ML models and workloads with Docker, ensuring seamless integration with our hardware.
• Use Terraform to define and manage infrastructure as code for consistent, repeatable deployments.
• Build and maintain CI/CD pipelines to automate the release of ML models and applications.
• Work with Kubernetes APIs to automate orchestration, scaling, and management of containerized environments.
• Develop deployment scripts and tools to empower users to adopt our AI solutions effortlessly.
• Collaborate with ML teams to troubleshoot and enhance production deployments.
• Apply your knowledge of LLMs and AI agents to optimize deployment workflows.
• Write efficient code in a compiled language (e.g., C, C++, Rust) and a high-level language (e.g., Python, Go) as needed.
• Ensure system reliability, security, and performance for mission-critical ML workloads.

Requirements

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
• OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 1+ year of Software Engineering or related work experience.
• OR PhD in Engineering, Information Systems, Computer Science, or related field.
• 2+ years of academic or work experience with Programming Language such as C, C++, Java, Python, etc.
• Proven experience deploying large-scale ML applications in production environments.
• Strong proficiency with Docker for containerization and Kubernetes (K8s) for orchestration.
• Hands-on experience with K3s for lightweight, edge-friendly ML deployments.
• Expertise in Terraform for infrastructure provisioning and management.
• Demonstrated ability to design and implement CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions).
• Familiarity with large language models (LLMs), AI agents, and their operational needs.
• Proficiency in a compiled language (e.g., C, C++, Rust) and a high-level language (e.g., Python, Go).
• Comfortable with automation scripting (e.g., Bash, Python) and system monitoring tools.

Nice to Have

• Understanding of ML frameworks like TensorFlow or PyTorch.
• Knowledge of cloud platforms (e.g., AWS, GCP, Azure) and hybrid environments.
• Background in optimizing workloads for specialized AI hardware.

Qualifications

• Educational qualifications as specified in requirements (Bachelor's, Master's, or PhD in relevant fields).

Benefits & Perks

• Competitive salary range: $111,300.00 - $166,900.00.
• Opportunity for annual discretionary bonus and RSU grants.
• Highly competitive benefits package supporting success at work, home, and play.