Principal Backend Developer

This role is for one of the Weekday's clients

Salary range: Rs 4500000 - Rs 8500000 (ie INR 45-85 LPA)

Min Experience: 6 years

Location: Bangalore

JobType: full-time

As a Principal Backend Developer, you will design, build, and optimize high-performance backend systems that power large-scale, distributed AI platforms. You will work closely with machine learning engineers, platform teams, and infrastructure groups to deploy AI-driven services, scale intelligent workflows, and efficiently serve models across diverse environments. This role is central to building robust, interoperable, and adaptive AI systems at scale.

Core Responsibilities

• Design, develop, and maintain backend services, microservices, and APIs using Golang
• Architect and operate distributed systems supporting high-throughput AI and data workloads
• Partner with ML engineers to integrate trained models into scalable, production-grade environments
• Build and manage real-time and batch inference pipelines for AI-powered applications
• Contribute to DevOps and MLOps workflows, including CI/CD automation, monitoring, observability, and autoscaling
• Ensure system reliability, performance, availability, and security across deployments
• Optimize internal tooling, model-serving infrastructure, and overall system efficiency
• Provide technical leadership through design reviews, architectural decisions, and best practices

Skills and Qualifications

• Strong hands-on experience building production systems using Golang
• Deep understanding of distributed systems, concurrency, and network programming
• Familiarity with machine learning frameworks such as PyTorch, TensorFlow, or JAX
• Experience with model-serving platforms like Triton Inference Server, TorchServe, ONNX Runtime, or Ray Serve
• Proficiency in containerization and orchestration using Docker and Kubernetes
• Experience with MLOps tools such as MLflow, Weights & Biases, Kubeflow, or Airflow
• Strong knowledge of cloud platforms (AWS, GCP, Azure) and infrastructure-as-code practices
• Experience with SQL and NoSQL databases, caching systems (e.g., Redis), and messaging systems (Kafka, RabbitMQ)
• Proficiency with Git and modern GitHub/GitLab workflows
• Bachelor’s degree in Computer Science, Engineering, or a related field is a plus

Nice to Have

• Experience working with large language models or foundation model architectures
• Familiarity with vector databases such as FAISS, Pinecone, or Weaviate
• Exposure to LLM orchestration frameworks like LangChain, LlamaIndex, or Haystack
• Experience with graph processing, streaming systems, or real-time inference platforms
• Interest in AI evaluation, interpretability, or AI safety practices

Why Join

• Build cutting-edge backend and infrastructure systems for applied AI at scale
• Collaborate with highly skilled engineers, researchers, and platform teams
• Opportunity to contribute to open-source tools and research-driven engineering
• Competitive compensation and a collaborative, in-office engineering culture