Azure +Databricks- Senior Associate

At PwC - AC, as an Azure Senior Developer, the candidate is responsible for end-to-end implementation of Cloud data engineering solutions. The candidate should have strong experience in Azure cloud using Storage services (Blob, ADLS,  PaaS SQL), Azure Data factory and Azure Databricks, Snowflake and SQL . Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cloud solutions. 

Years of Experience: Candidates with 4-8 years of hands on experience 

Must Have: 

• 4+  years of experience working in Azure ADLS, Databricks, Azure Data factory, SQL, Data Flows, Snowflake 

• Should be aware of Data Management concepts and Data Modelling 

• Good knowledge of Big Data frameworks and related technologies - Experience in Spark is mandatory 

•  Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc. 

• Good knowledge of Big Data frameworks and related technologies - Experience in Spark is mandatory 

• Should have clear understanding of DW lifecycle and contributed in preparing  

•  Detail Level Design document 

•  Unit Test plans 

•  Code review reports 

• Must have strong sql, understand joins, groups, functions & Stored procedures 

• Must have experience  in Unit and Integration Test creation and verification 

• Proficient in creating documentation related to Project Architecture, Project end User Manual and Operations Hand off guide 

• Should have good understanding of Data Migration and integration processes, methods and project lifecycle 

• Strong analytical skills and troubleshooting skills 

• Should be well versed with quality processes and implementation 

• Excellent communication skills 

• Strong understanding of Cloud data migration processes, methods and project lifecycle 

• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit 

Desired Knowledge / Skills: 

• Certifications in Azure / Databricks 

• Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming  

• Experience in Azure functions, Logi Apps, Microsoft Purview, Cosmos DB 

• Knowledge in Python 

Professional and Educational Background: 

• BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA