Data Engineering Analyst HIH Evernoth

Job Description & Responsibilities: 

• Work with business and technical leadership to understand requirements 

• Design to the requirements and document the designs 

• Ability to write product-grade performant code for data extraction, transformations and loading using Spark, Py-Spark 

• Do data modeling as needed for the requirements 

• Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and Hive 

• Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS or Hadoop Edge Nodes 

• Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment 

• Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives