AI Platform Engineer

About the company:
We are in the tech industry, specializing in cutting-edge AI solutions and advanced platform development. With a mission to empower businesses through intelligent automation and data-driven insights, we foster a collaborative and forward-thinking environment where creativity and technical excellence thrive.

Job responsibilities:
- Own the end-to-end build of an AI model service platform, starting from zero, engineered to grow into a system that can reliably serve user bases in the hundreds of thousands to millions.
- Architect and continuously scale a unified layer of model API interfaces, overseeing how requests are routed across models, how load gets balanced, and how the service expands over time — all while keeping AI-driven services running reliably for connected hardware.
- Deep working knowledge of today's leading AI models and their APIs
- Solid backend development skills, with experience in cloud deployment, microservices, and inference frameworks, and the ability to iteratively scale and improve systems in production.
- Business-savvy and outcome-driven, comfortable partnering across Agent teams, hardware teams, and other functions to keep the platform's direction tied to broader company goals.
 
Requirements:
- Bachelor's degree in Computer Science, Software Engineering, or a related field
- Strong backend development experience (Java, Go, Python, or similar)
- Hands-on experience with cloud platforms (AWS, Azure, GCP, or Alibaba Cloud)
- Experience with microservices architecture and API design
- Familiarity with AI/LLM APIs (OpenAI, Anthropic, Qwen, etc.) and inference frameworks (e.g., vLLM, Triton, TGI)
- Experience building systems that scale to high user volumes
- Understanding of load balancing, service routing, and distributed systems
- Good communication skills; able to work with cross-functional teams (Agent, hardware, product)