Software Engineer -AI Backend

About the Team

At KPMG Israel, our Generative AI delivery team builds end-to-end AI-powered products for clients across diverse industries. Our projects range from intelligent API services to complete production systems including user management, complex databases, process orchestration, and cloud infrastructure. We combine strong software engineering with AI capabilities to deliver solutions that create real business value.

About the Role

We're looking for a Software Engineer with strong backend and cloud expertise to join our AI team. You'll design and build backend systems that integrate Generative AI capabilities, contributing across the stack from API development to cloud deployment.

This role is ideal for someone who thinks in systems, loves solving complex problems, and can go deep into implementation details while keeping the big picture in mind. You'll work closely with our team lead on architectural decisions and take ownership of project delivery.

Key Responsibilities

Systems Design & Development

• Design and build complete backend systems APIs, databases, queues, authentication, and integrations
• Develop Python services with strong focus on code quality, performance, and reliability

·        Design solutions that scale across different client environments (cloud and on-prem)

AI Integration

• Integrate LLMs (Multi Agents Systems) and GenAI capabilities into production systems
• Build orchestration layers and workflows that combine AI with traditional backend logic
• Optimize AI system performance, cost, and reliability

Cloud & Infrastructure

• Deploy and manage systems across major cloud platforms (GCP, Azure, AWS)
• Work with cloud-native services, databases, and infrastructure tools
• work with production systems, monitoring, and operational health

Collaboration & Delivery

• Communicate with client development teams, DevOps, and business stakeholders
• Guide frontend developers on API contracts and integration requirements
• Contribute to technical decisions and solution design within the team

Client Engagement & Advisory

• Lead technical discussions with clients and translate business needs into technical architectures
• Present GenAI solutions, design decisions, and trade-offs to technical and non-technical stakeholders

 Provide strategic technical guidance 

Must Have

• 3+ years of relevant software engineering experience
• Working knowledge of GenAI concepts and LLM integration
• Strong proficiency in Python for backend development
• Solid experience designing and building production systems (APIs, Microservices, databases, message queues, authentication)
• Hands-on experience with at least one major cloud platform (GCP, Azure, or AWS)
• Understanding of software architecture patterns and best practices

·        Bachelor’s degree in Computer Science or related field or equivalent practical experience

Advantages                                                                                                                          

• Experience with multiple cloud platforms
• Docker and Kubernetes experience
• Experience with LLM provider APIs (OpenAI, Anthropic, Google) including function calling and streaming
• Data pipeline development experience

What We're Looking For

• Strong problem-solving skills ability to model a problem correctly and propose complete solutions
• Attention to detail and ability to go deep into implementation

·         Ability to quickly learn and apply new technologies, especially in the GenAI space

·         Clear technical communication skills

• Comfort working in a fast-paced consulting environment with varying project types

What We Offer

• Variety of projects from focused AI services to complete production systems.
• Exposure to multiple industries, cloud platforms, and technical challenges.
• Opportunity to grow technical leadership skills.
• Collaborative team environment with hands-on architectural guidance.
• Continuous learning in a rapidly evolving field.