Software Engineer - AI Infrastructure

About the Role

Key Responsibilities

• Design and implement scalable infrastructure solutions to support the deployment of large language models.
• Optimize compute, storage, and networking resources to enhance the performance and cost-efficiency of LLM operations.
• Develop and maintain tools for monitoring and managing LLM performance, including resource utilization, latency, and throughput.
• Implement security measures and best practices to protect sensitive data processed by LLMs.
• Troubleshoot and resolve infrastructure issues in a timely manner, ensuring minimal disruption to model deployment and availability.
• Stay updated with advancements in AI infrastructure technologies and contribute to the adoption of new tools and frameworks.
• Document infrastructure designs, processes, and configurations for knowledge sharing and training purposes.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Demonstrated interest in designing, building, and supporting Internet serving infrastructure, machine learning platforms, machine learning services and frameworks.
• Strong programming skills in at least one of Python, Go, Java, C++.
• Familiarity with cloud computing platforms such as AWS, Azure, or GCP.
• Experience with containerization and orchestration tools such as Docker and Kubernetes.
• Excellent problem-solving skills and ability to troubleshoot complex issues in a production environment.
• Strong communication skills and ability to collaborate effectively in a team environment.
• Ability to adapt to a fast-paced and evolving technological landscape.

Benefits & Perks

• Competitive salary with an estimated base range of $157,000 - $230,000.
• Participation in Snowflake's bonus and equity plan.
• Medical, dental, vision, life, and disability insurance.
• 401(k) retirement plan.
• Flexible spending and health savings accounts.
• At least 12 paid holidays and paid time off.
• Parental leave.
• Employee assistance program and other company benefits.