Sr Data Engineer

Job Summary

We are seeking a highly skilled Databricks Engineer with
AI/ML experience to design, build, and optimize scalable data and machine
learning platforms on Databricks. The role involves end -to -end ownership of
data pipelines, ML workflows, and production AI systems.

Key Responsibilities

• Design
  and implement scalable ETL pipelines using Databricks & Spark
  
• Build
  Lakehouse architecture using Delta Lake
  
• Develop
  and deploy ML models using MLflow
  
• Implement
  MLOps pipelines for training, testing, and serving models
  
• Optimize
  cluster performance and reduce compute cost
  
• Build
  RAG and LLM -based solutions using Mosaic AI
  
• Integrate
  analytics with BI tools (Power BI, Tableau)
  
• Implement
  data governance using Unity Catalog
  
• Collaborate
  with Data Scientists and Business teams
  
• Ensure
  data quality, security, and compliance
  

Required Skills

Mandatory

• 5+
  years of Databricks & Apache Spark
  
• Strong
  Python & PySpark
  
• Experience
  with Delta Lake & Lakehouse
  
• MLflow
  & MLOps experience
  
• Cloud
  platform (AWS/Azure/GCP)
  
• Git
  & CI/CD
  

Preferred

• Experience
  with LLMs & Generative AI
  
• RAG
  pipelines & Vector Databases
  
• Deep
  Learning frameworks
  
• Databricks
  certifications
  
• Power
  BI integration
  

Requirements

Job Summary

We are seeking a highly skilled Databricks Engineer with
AI/ML experience to design, build, and optimize scalable data and machine
learning platforms on Databricks. The role involves end -to -end ownership of
data pipelines, ML workflows, and production AI systems.

Key Responsibilities

• Design
  and implement scalable ETL pipelines using Databricks & Spark
  
• Build
  Lakehouse architecture using Delta Lake
  
• Develop
  and deploy ML models using MLflow
  
• Implement
  MLOps pipelines for training, testing, and serving models
  
• Optimize
  cluster performance and reduce compute cost
  
• Build
  RAG and LLM -based solutions using Mosaic AI
  
• Integrate
  analytics with BI tools (Power BI, Tableau)
  
• Implement
  data governance using Unity Catalog
  
• Collaborate
  with Data Scientists and Business teams
  
• Ensure
  data quality, security, and compliance
  

Required Skills

Mandatory

• 5+
  years of Databricks & Apache Spark
  
• Strong
  Python & PySpark
  
• Experience
  with Delta Lake & Lakehouse
  
• MLflow
  & MLOps experience
  
• Cloud
  platform (AWS/Azure/GCP)
  
• Git
  & CI/CD
  

Preferred

• Experience
  with LLMs & Generative AI
  
• RAG
  pipelines & Vector Databases
  
• Deep
  Learning frameworks
  
• Databricks
  certifications
  
• Power
  BI integration