Data Engineer

Company : Kumaran Systems

Job Type : Full Time

Toronto, Canada

Job Description - Data Engineer

Required Skills.

• Strong hands-on experience with Data-bricks and Apache Spark (PySpark/Scala).

• Experience in SQL and data transformation techniques.

• Knowledge of ETL tools and data pipeline development.

• Experience working with cloud platforms (Azure/AWS/GCP)

• Strong Azure cloud background

• Understanding of data warehousing concepts.

• Strong problem-solving and analytical skills.

• Hands-on experience with Azure Data bricks or Delta Lake, in building ETL pipelines : batch (autoloader) and Spark structured streaming

• Knowledge of data modelling and performance tuning in Spark.

• Exposure to CI/CD pipelines and DevOps practices.

• Familiarity with data governance and security practices.

• Strong hands on working experience of Unity catalog:

• Hands on exposure to Creating end to end environments : creating catalogs, schemas, tables . materialized views, functions, volumes

• Experience in building SCD 1 and SCD2 (slowly changing dimensions ) on dimension tables

• Experience in building CDC (change data capture pipelines)

• Strong hands on experience with Lakehouse federation , creating foreign catalogs to get data from external sources

• Strong understanding of databricks partitioning , Liquid clustering

Original job Data Engineer posted on GrabJobs ©. To flag any issues with this job please use the Report Job button on GrabJobs.

Share Job

Get your Resume Reviewed for Free

Similar Data Engineer Jobs in Canada

Get your Resume Reviewed for Free

Email address

Why are you reporting this job?

I think it’s a discriminatory or offensive

I think it’s fraudulent or a scam

I think it’s trying to sell something unrelated to the job / it’s asking for money

I think it contains incorrect or broken information

Other

All Job Ads are subject to GrabJobs’s Terms of Service. We allow users to flag postings that may be in violation of those terms. Job Ads may also be flagged by GrabJobs moderation team. However, no moderation system is perfect, and flagging a posting does not ensure that it will be removed.

Setup your job alert:

Frequency

By activating job alerts, I agree to GrabJobs Terms & Privacy Policy. I can unsubscribe to job alerts anytime. Skip

Data Engineer

Job Description - Data Engineer

Similar Data Engineer Jobs in Canada

Mobile Apps