Data Engineer

Job Description:

• Working days: Tuesday to Saturday.
  


• Working hours: 10.00 AM. - 19.00 PM. (Winter time) and 11.00 AM. - 20.00 PM. (Summer time).


• Analyze data sources, both internal and external, and maintain metadata document.


• Perform data profiling and analyze the results to identify data quality issues.


•  Perform all types of data Ingestion patterns: Batch, Near Real Time and oncoming streams of information.


• Develop automated data pipelines for extraction, loading and transformation of data from a wide variety of data sources.


• Identify, design, and implement internal process improvements: automating manual processes and ingestion monitoring report.


• Support and resolve data issues and queries raised by internal customers


• Support business decisions with ad hoc analysis as needed

Qualification:

• Bachelor's degree or higher in Computer Science, Information Technology, Computer Engineer or other related fields.


• 1-3 years’ experience with Big data technologies and frameworks: Snowflake and AWS.


• 1-3 years’ experience with ETL, data warehousing, data modeling, and working with large-scale datasets.


• 1-3 years’ experience with Python.


• 1-3 years’ experience with SQL, Linux/Unix experience preferred. 


• Experience with setting up and configuring monitoring tools such as Splunk, DataDog...


• Knowledge in Databricks, Jenkins and git is a plus.


• Passionate and curious about data with strong commitment to producing quality deliverables.


• Strong analytical thinking, problem solving, and interpersonal skills.


• Ability to be self-directed and work independently, as well as collaboratively.


• Good English communication skills are required.


• Able to work on shift. 

What you will get from ATA IT:

• 14 days’ vacation in first year.


• Life insurance.


• Provident fund.


• Monthly Activities- Staff Birthday & Company Activities.


• Hybrid Work from Home.


• Annual Health Check


• Annual Party.


• Dental fee for staff & families.


• Health insurance for staff & families.