PySpark Data Engineer

Roles and
Responsibilities:

• Responsible
  for developing and maintaining applications with PySpark
  
• Contribute
  to the overall design and architecture of the application developed and
  deployed.
  
• Performance
  Tuning wrt to executor sizing and other environmental parameters, code
  optimization, partitions tuning, etc
  
• Interact
  with business users to understand requirements and troubleshoot issues.
  
• Implement
  Projects based on functional specifications.
  

Must -Have
Skills:

• Relevant
  Experience: 3 -6 Years 
  
• SQL -
  Mandatory
  
• Python -
  Mandatory
  
• SparkSQL -
  Mandatory
  
• PySpark -
  Mandatory
  
• Hive -
  Mandatory
  
• HDFS and
  Spark - Mandatory
  
• Scala -
  Advantage
  
• Apache
  Airflow - Advantage  
  

Requirements