LLM Engineer

About the Role

Key Responsibilities

• Enhance and expand a complex, dynamic application.
• Collaborate with global teams across multiple time zones.
• Actively contribute to ongoing feature development.

Requirements

• 2+ years of experience developing and experimenting with LLMs.
• 8+ years of experience developing APIs with Python.
• Extensive experience with Python, particularly in building REST APIs using frameworks like FastAPI or Flask.
• Expertise in microservices architecture and deployment in containerized environments (e.g., Docker, Kubernetes).
• Strong knowledge in AI, machine learning, and natural language processing.
• Proficient in working with key LLM model APIs (e.g., OpenAI, Anthropic) and LLM frameworks (e.g., LangChain, LlamaIndex).
• Experience with MCP (Model Context Protocol).
• Understanding of multi-agent systems and their applications in complex problem-solving scenarios.
• Familiarity with RAG concepts and fundamentals (vectorDBs, semantic search, etc.).
• Expertise in implementing RAG systems that combine knowledge bases with generative AI models.
• Skilled in prompt writing for various use cases.
• Experience with deploying generative solutions to production at scale, beyond POCs.
• Proficiency with server-side events, event-driven architectures, and messaging systems.
• Strong problem-solving skills and experience in debugging and optimizing backend systems.
• Solid understanding of security best practices for backend systems, including authentication and data protection.
• Can work IST and UST hours.
• Experience with LLM guardrails.
• Experience with LLM monitoring and observability.
• Experience developing AI/ML technologies within large and business-critical applications.

Nice to Have

• Experience with multi-agent systems and their applications.
• Knowledge of RAG concepts and fundamentals such as vectorDBs and semantic search.
• Experience with deploying generative AI solutions at scale.
• Understanding of security best practices for backend systems.

Qualifications

• 2+ years of experience developing and experimenting with LLMs.
• 8+ years of experience developing APIs with Python.

Benefits & Perks

• Compensation ranging from $65/hr to $85/hr, depending on skills, experience, and education.
• Comprehensive benefits package starting on day one, including medical, dental, and vision insurance.
• Eligibility to enroll in the 401(k) retirement plan after 90 days of employment.
• Access to paid sick leave and other paid time off benefits as required by law.