Big Data Architect

Position:
Big Data Architect (Contract - 6 months)Location:
Toronto, ON

Responsibilities:

• Lead a team of big data developers in designing, developing, and maintaining big data solutions.
• Architect and implement ETL (Extract, Transform, Load) processes for large data sets using technologies such as HDFS, Yarn, Hive, CDP, and Hadoop.
• Collaborate with data engineers, data scientists, and business analysts to ensure efficient data processing.
• Write efficient code in Java, Scala, and Apache Spark for data transformation and analysis.
• Optimize data pipelines for performance, scalability, and reliability.
• Mentor and guide junior team members, providing technical leadership.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• Minimum 8 years of experience
  in big data development, including team leadership.
• Proficiency in Java, Scala, and Apache Spark.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with HDFS, Yarn, and Hive.
• Excellent problem-solving skills and attention to detail.
• Knowledge of version control tools (e.g., Git) and continuous integration (CI/CD) pipelines.

Additional Information:

• This is a 6-month contract position with the possibility of extension.
• The role may involve a hybrid work arrangement (partially remote, partially on-site).