Data Engineer

• Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
  


• Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
  


• Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
  


• Required to participate in early state design and feature definition activities.
  


• Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
  


• Responsible for creating reusable and scalable data pipelines
  


• Act as a team-player while collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  

Requirements

• Advanced working knowledge and experience with relational and non-relational databases
  


• Experience building and optimizing Big Data pipelines, architectures, and data sets
  


• Strong analytic skills related to working with unstructured datasets
  


• Expertise in Azure Data factory, Databricks, EventHub, Python, PySpark ,Azure Synapse and SQL.
  


• Azure DevOps experience mandatory to deploy the data objects.
  


• 7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience.
  


• Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
  


• Automotive domain experience is a must.
  


• Knowledge/Experience with Azure cloud stack.
  


• Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage.
  


• Certification on Azure platform toolset will be considered as added advantage
  


• Bachelor’s degree in Computers or allied field of study.