MS FDL-Data Engineeirng Architect-Manager

Job Title: Senior Data Architect- 

Summary:

We are looking for highly skilled and experienced Senior Data Architect with extensive knowledge of Oracle ERP, SAP, and Databricks to join our team and play a crucial role in designing and implementing data quality solutions. You will be responsible for leading the development and implementation of strategies and processes to ensure the accuracy, completeness, and consistency of our data across the organization, specifically focusing on data within Oracle ERP and SAP systems, while leveraging the capabilities of Databricks for data processing and transformation, including building and maintaining ETL pipelines using PySpark.

Responsibilities:

• Partner with business stakeholders and data engineers to understand data quality requirements and challenges specific to Oracle ERP, SAP systems, and within the context of big data processing using Databricks, including ETL development needs.


• Design and implement data quality solutions, including data cleansing, transformation, and validation processes for data originating from Oracle ERP, SAP, and processed within Databricks, utilizing PySpark for building and maintaining ETL pipelines.


• Develop and maintain data quality standards, policies, and procedures specifically tailored to Oracle ERP, SAP, and Databricks data integration, processing, and ETL development.


• Select and implement data quality tools and technologies compatible with Oracle ERP, SAP, and Databricks, including PySpark libraries and functionalities for ETL development within Databricks.


• Monitor and assess data quality metrics within Oracle ERP, SAP, and Databricks pipelines, including those related to ETL performance and data quality within ETL processes.


• Develop and implement data governance frameworks to ensure data quality and compliance, focusing on Oracle ERP, SAP, and Databricks data integration, processing, and ETL development.


• Own the data performance and cost for the ETL frameworks and jobs in production.


• Collaborate with data analysts and scientists to ensure data used in analysis from Oracle ERP, SAP, and processed through Databricks, including data transformed through ETL pipelines, is high-quality and reliable.


• Document data quality processes and solutions for future reference, specifically regarding Oracle ERP, SAP, and Databricks data integration, processing, and ETL development.


• Stay up to date on the latest trends and innovations in data quality technologies and best practices, particularly those relevant to Oracle ERP, SAP, Databricks, and PySpark for ETL development.

Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field (Master’s degree preferred).


• 12+ years of experience as a Data Architect or similar role.


• Extensive knowledge of data quality principles and methodologies as applied to Oracle ERP, SAP systems, and big data processing in Databricks.


• Experience in designing and implementing data quality solutions using various tools and technologies compatible with Oracle ERP, SAP, and Databricks (e.g., data profiling, data cleansing tools, data quality monitoring tools within Databricks).


• Strong understanding of Oracle ERP and SAP data models, functionalities, and integrations.


• Experience working with Oracle and SAP data extraction, transformation, and loading (ETL) processes.


• Experience and expertise in utilizing Databricks for data processing, transformation, and analytics workflows, including building and maintaining ETL pipelines using PySpark.


• Familiarity with data quality best practices within the context of enterprise resource planning (ERP) systems and big data processing.


• Strong analytical and problem-solving skills.


• Excellent communication and collaboration skills.