Principal Engineer (Data Platform)

This role is for one of Weekday’s clients
Min Experience: 12 years
Location: Bengaluru
JobType: full-time

We are looking for a seasoned Principal Engineer to lead the design and development of next-generation data pipelines that enable near real-time ingestion and processing of massive datasets using cloud-native and open-source technologies.
 

Why Join

• Work on cutting-edge challenges at the intersection of big data, security, and cloud computing.
• Shape the direction of high-impact, global-scale data products.
• Collaborate with top industry experts while strengthening your technical and architectural depth.
   

Key Responsibilities
 

• Architect and build scalable, fault-tolerant, low-latency data pipelines for real-time/near real-time processing.
• Partner with cross-functional teams to design innovative solutions for complex data and security problems.
• Evaluate, adopt, and contribute to open-source technologies that enhance the data platform ecosystem.
• Influence product and engineering teams by providing guidance on architecture and platform best practices.
• Act as a thought leader, driving technical direction and innovation within the data engineering domain.
   

Required Skills & Experience
 

• Experience range more than 12+ years. 
• Extensive experience architecting and scaling real-time/near real-time data systems.
• Strong analytical and problem-solving skills, with ability to simplify complex technical challenges.
• Deep expertise in distributed systems, concurrency, and performance optimization.
• Proficiency in Golang, Java, or similar languages.
• Solid understanding of gRPC streaming, serialization formats (Protobuf, Avro), and distributed security models (TLS, authentication, authorization).
• Hands-on experience with distributed object storage (S3, GCS) and data formats (Parquet, Iceberg), including optimization for scale and performance.
• Strong background in cloud-native data infrastructure (AWS, GCP, etc.).
• Excellent communication skills and proven ability to influence and align teams globally.