Data Engineer

Description

• Design and maintain scalable pipelines for ingesting, processing, and validating datasets with main focus visual and voice data.
• Work with other teams to identify workflow optimisation potential, design and develop automation tools, using AI-driven tools and custom model integrations and scripts.
• Write and maintain tests for pipeline reliability.
• Build and maintain observability tooling in collaboration with other engineers to track data pipeline health and system performance.
• Collaborate with data scientists, operators, and product teams to deliver data solutions.
• Debug and resolve complex data issues to ensure system performance.
• Optimise storage, retrieval, and caching strategies for large media assets across environments.
• Deploy scalable data infrastructure using cloud platforms as well as on-premise and containerization.
• Deepen your knowledge of machine learning workflows to support AI projects.
• Stay current with industry trends and integrate modern tools into our stack.

• 3+ years in data engineering or related backend/infrastructure role.
• Strong programming skills in Python or similar languages.
• Experience with software development lifecycle (SDLC) and CI/CD pipelines.
• Proven experience building and testing data pipelines in production.
• Proficiency in Linux.
• Solid SQL knowledge.
• Experience with Docker or other containerisation technologies.
• Proactive approach to solving complex technical challenges.
• Passion for system optimisation and continuous learning.
• Ability to adapt solutions for multimedia data workflows.

About BRAHMA AI:

BRAHMA AI is the next generation of enterprise media technology formed through the integration of Prime Focus Technologies and Metaphysic. By combining CLEAR®, CLEAR® AI, ATMAN, and VAANI into one ecosystem, BRAHMA AI enables enterprises to manage, create, and distribute content with intelligence, security, and efficiency.



Proven, scalable, and enterprise-tested, BRAHMA AI is helping global organizations accelerate growth, efficiency, and creative impact in the AI-powered era.