Data Engineer Advisor

Migration Strategy & Execution Design and implement migration plans for SAP data to Azure Databricks using tools like Qlik Replicate, ADF, and Airflow. Convert SAP BW data models and ETL jobs into PySpark workflows on Databricks. Develop Bronze, Silver, and Gold layers following Medallion Architecture for structured ingestion and transformation. Data Integration & Quality Ensure accurate mapping of SAP tables and business objects to Databricks Delta tables. Implement data quality checks, lineage tracking, and governance using Unity Catalog. Performance Optimization Optimize ingestion pipelines for large SAP datasets to minimize latency and maximize throughput. Conduct performance tuning for queries and transformations. Collaboration & Documentation Work closely with SAP SMEs, data architects, and business analysts to validate requirements. Produce comprehensive documentation for migrated jobs and provide support during UAT and hypercare phases. Ensure compliance with enterprise security policies and manage RBAC for Databricks workspaces. Strong knowledge of SAP BW, ECC, and related modules. Databricks & Big Data Proficiency in Databricks, PySpark, and Delta Lake. Familiarity with Azure Data Lake Storage (ADLS) and orchestration tools like Airflow. ETL/ELT Tools Hands-on experience with Qlik Replicate, Informatica, or similar tools. Cloud & Governance Understanding of Unity Catalog, RBAC, and data governance frameworks. "