Advisory - Deals - Forensic - Quality Engineer - Senior Associate - Kolkata

We are seeking an experienced Data Engineer with expertise in Databricks to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing data workflows and pipelines using Databricks. You will collaborate with cross-functional teams to ensure data accessibility, reliability, and performance. 

**Key Responsibilities**: 

- Design and develop scalable data pipelines and workflows using Databricks. 

- Collaborate with data scientists and analysts to support data-driven projects and initiatives. 

- Optimize and manage data processing tasks on the Databricks platform to ensure high performance and cost efficiency. 

- Integrate Databricks with various data sources and storage solutions. 

- Implement ETL processes and ensure data quality and consistency across different environments. 

- Maintain and monitor Databricks infrastructure, troubleshooting issues as they arise. 

- Ensure compliance with data security policies and regulations. 

**Qualifications**: 

- Bachelor’s degree in Computer Science, Engineering, or a related field. 

- Proven experience in data engineering with a focus on Databricks. 

- Strong proficiency in Python and/or Scala for developing data processing workflows. 

- Expertise in SQL for data extraction and manipulation. 

- Familiarity with big data technologies and cloud platforms, such as AWS, Azure, or Google Cloud. 

- Strong problem-solving skills and the ability to work in a fast-paced environment. 

**Preferred Qualifications**: 

- Experience with data lake architectures and Delta Lake. 

- Knowledge of Apache Spark and its integration with Databricks. 

- Understanding of data modeling and warehousing concepts. 

- Experience with CI/CD practices for data pipelines.