Data Migration Architect - Contract - Sydney

Requirements

• Seeking a highly experienced Data Migration Architect to lead the end-to-end migration of enterprise data workloads from Greenplum to Databricks.
  


• The ideal candidate will have deep expertise in legacy data warehouse systems, modern cloud data platforms, and data migration strategies.
  


• This role involves architecture design, planning, execution, and optimization of scalable data pipelines and transformation logic.
  

• Design and implement a robust data migration strategy from Greenplum to Databricks.
  


• Assess existing Greenplum schemas, workloads, and performance characteristics.
  


• Define target architecture in Databricks including Lakehouse design, Delta tables, and optimized storage formats.
  


• Develop scalable ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.
  


• Ensure data integrity, consistency, and performance during migration.
  


• Collaborate with data engineers, analysts, and business stakeholders to validate migrated data.
  


• Implement monitoring, logging, and rollback mechanisms for migration processes.
  


• Document migration processes, architecture decisions, and operational runbooks.
  


• Lead large scale data migration with complex workflows & varied data types complexity for migration.
  

• 10+ years of experience in data engineering or data architecture roles.
  


• Proven experience with Greenplum (PostgreSQL-based MPP systems) to Databricks experience – 2 or more projects.
  


• Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.
  


• Proficiency in SQL, Python, and PySpark.
  


• Experience with AWS cloud platform.
  


• Familiarity with data governance, security, and compliance in cloud environments.
  


• Excellent problem-solving and communication skills.
  


• Certifications in Databricks or cloud platforms (Azure/AWS/GCP) is preferable
  


• Experience with orchestration tools like Airflow is preferred