Databricks + PySpark - Technical Lead-Data Engg

Area(s) of responsibility

• Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)


• Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.


• Experience in creating Technical Specification Design, Application Interface Design.


• Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark


• Develop batch processing and integration solutions and process Structured and Non-Structured Data


• Demonstrated in-depth skills with  Databricks and PySpark, and SQL


• Collaborate and engage with BI & analytics and the business team.

• Minimum 2 to 3 year of Project experience in Azure Databricks


• Minimum 2-3 years of experience in ADF


• Minimum 2+ years of experience in PySpark

Location: Mumbai, Pune, Noida, Bangalore