Senior Software Engineer- BE

'

: - ( - )

Experience: 5+ yrs

Location: Bengaluru, Karnataka, India

Job Type: Full-time

We are seeking a highly skilled Senior Software Engineer – Backend to design, build, and scale next-generation AI platform services that power enterprise-grade intelligent applications. This role is ideal for engineers with strong expertise in Java, cloud-native microservices, distributed systems, and AI platform architecture, along with hands-on experience integrating Large Language Models (LLMs), agent orchestration frameworks, and modern backend technologies.

As a senior member of the engineering team, you will own the development of scalable backend services, AI gateways, and orchestration frameworks while collaborating with cross-functional teams to deliver secure, reliable, and high-performance solutions. The role demands strong technical leadership, excellent problem-solving skills, and a passion for building production-ready AI-powered platforms.

Key Responsibilities

• Design, develop, and maintain production-grade backend services for AI platforms, including LLM gateways, model integration services, and agent orchestration frameworks.
• Build scalable cloud-native microservices using Java, Spring Boot, Kafka, and modern distributed system design principles.
• Architect and implement AI gateway capabilities such as multi-provider model routing, intelligent failover, token management, cost optimization, request logging, and observability.
• Develop infrastructure supporting Model Context Protocol (MCP), tool integration, and intelligent agent workflows.
• Design and implement multi-step AI reasoning workflows, tool orchestration, guardrails, and human-in-the-loop processes for enterprise AI applications.
• Take end-to-end ownership of critical backend components, ensuring scalability, security, reliability, and maintainability.
• Diagnose and resolve complex performance bottlenecks across backend services, AI inference layers, and distributed architectures.
• Collaborate with Product, AI/ML, QA, UX, and Engineering teams to design and deliver high-quality software solutions.
• Mentor junior engineers through technical guidance, code reviews, architecture discussions, and engineering best practices.
• Promote software quality through clean code, automated testing, performance optimization, and continuous improvement initiatives.

What Makes You a Great Fit

• 5+ years of professional experience in backend software engineering with strong expertise in Java and object-oriented programming.
• Proven experience building and scaling cloud-native microservices and enterprise backend applications using Spring Boot, Kafka, and distributed architectures.
• Strong understanding of relational and NoSQL databases, including MySQL, MongoDB, and modern data management practices.
• Experience developing enterprise-scale applications with strong knowledge of performance tuning, debugging, monitoring, and backend optimization.
• Hands-on experience with cloud platforms such as AWS and familiarity with observability tools, logging frameworks, and monitoring solutions.
• Solid understanding of Large Language Models (LLMs), AI platform architecture, and intelligent application development.
• Experience or strong knowledge of Model Context Protocol (MCP), AI gateways, multi-model routing, semantic caching, and AI service orchestration.
• Familiarity with agentic AI frameworks such as LangChain, LangGraph, LlamaIndex, CrewAI, OpenAI Agents SDK, or similar orchestration technologies.
• Understanding of AI observability, evaluation techniques, prompt execution monitoring, AI safety practices, content filtering, and hallucination mitigation.
• Excellent analytical thinking, communication, mentoring, and collaboration skills with the ability to thrive in a fast-paced engineering environment while delivering high-quality, production-ready solutions.