Data Engineer

Company : Ellow Talent Marketplaces Pvt

Job Type : Full Time

Gurgaon Kty., Haryana

Job Description - Data Engineer

Budget : 5 to 10 yrs - 28 LPA , 10+ Yrs - 35 LPA

Hybrid – 3 Days / week work or 12 Days / Month from Any Xebia Office

Shift Timings - 2 to 11 pm - IST
Key Core Skills - Python, Pyspark, SQL, GCP, DBT
JD:
We have 1000 + Data Pipeline that is using Databricks Cluster to perform the Data Transformation(Raw-->Silver-->Gold) and orchestrated using Airflow. Both Databricks and Airflow are powered using GCP Platform. The Curated Datasets are exposed to the end users using Databricks Notebook Interface and Big query. In the future, we want to migrate to a framework that will use GCP Cloud Native tools that can effectively run Spark Workloads. We will need to understand the current landscape well and chalk out a plan to migrate the workloads to the new Framework based approach.

Key Responsibilities: We are seeking a highly skilled and experienced Engineer to help us with the design and implementation of Future GCP Native Data Processing Framework. The ideal candidate will have extensive experience building scalable data solutions, strong analytical skills, and a passion for leveraging GCP Services to develop Tools and Framework to support Data Engineering Teams.
Help with the design and implementation of the of the Data Processing Framework that leverages GCP Cloud Native Services.
Ensure data integrity, consistency, and availability across all data systems.
Develop documentation and standards for data processes and procedures.
Experience:
Minimum of 10+ years of experience in data engineering, with a focus on data architecture and pipeline development.
Proven experience with Cloud platforms (GCP) and big data technologies (e.g., PySpark, Databricks, Big Query, GCP Services)
Proven experience with Orchestration Solutions (e.g., Airflow,Dagster, Comparable GCP Services).
Understanding of Data Lake Table Formats like Delta, Iceberg.
Skills:
Proficiency in programming languages such as Python
Familiarity with data lake architectures and best practices.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration

Original job Data Engineer posted on GrabJobs ©. To flag any issues with this job please use the Report Job button on GrabJobs.

Share Job

Get your Resume Reviewed for Free

Similar Data Engineer Jobs in India

Get your Resume Reviewed for Free

Email address

Why are you reporting this job?

I think it’s a discriminatory or offensive

I think it’s fraudulent or a scam

I think it’s trying to sell something unrelated to the job / it’s asking for money

I think it contains incorrect or broken information

Other

All Job Ads are subject to GrabJobs’s Terms of Service. We allow users to flag postings that may be in violation of those terms. Job Ads may also be flagged by GrabJobs moderation team. However, no moderation system is perfect, and flagging a posting does not ensure that it will be removed.

Setup your job alert:

Frequency

By activating job alerts, I agree to GrabJobs Terms & Privacy Policy. I can unsubscribe to job alerts anytime. Skip

Data Engineer

Job Description - Data Engineer

Similar Data Engineer Jobs in India

Mobile Apps