Senior Databricks Data Engineer

Senior Data Engineer (AI & Databricks)

Work Authorization: U.S. Citizens (USC) & Green Card Holders (GC) only

Required Skills

• Databricks
  


• AI/ML
  


• Python
  


• Azure API Development
  


• ETL Pipeline Development
  


• DevOps & CI/CD
  


• Apache Spark
  


• SQL
  


• Azure Data Services
  

Key Responsibilities

• Design and develop scalable batch and real-time data pipelines.
  


• Build robust data ingestion, transformation, and analytics workflows.
  


• Develop intelligent APIs and data products to support AI and business applications.
  


• Ensure high data quality, reliability, and performance.
  


• Collaborate with cross-functional teams to deliver scalable data solutions.
  


• Support Azure-based data platforms for BI and AI/ML initiatives.
  


• Participate in code reviews and implement CI/CD best practices.
  

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
  


• 10+ years of experience in Data Engineering.
  


• Strong expertise in Databricks, Apache Spark, and cloud-based data platforms.
  


• Proficiency in Python and SQL.
  


• Hands-on experience with Azure data services and REST API development.
  


• Experience with DevOps, CI/CD pipelines, and Agile methodologies.