Data Engineer

Overview :

• PureSoftware is a global software products and digital services company that is driving transformation for the world’s top organizations across the most regulated industry verticals, including banking and financial services, telecom, healthcare, gaming, and entertainment.
• With a strong presence in 5 continents, the company helps organizations modernize technology, reimagine processes, and transform experiences so they stay ahead in a fast-changing world. PureSoftware focuses on driving a differentiated customer experience, accelerating cycle time, and improving business outcomes through the integration of digital solutions, robotic automation, artificial intelligence, machine learning, and IOT.

Are you passionate about being a part of a high-performance team where your work has a meaningful impact on people and processes? Do you get excited about effectiveness and efficiency?

Are you looking for an opportunity to accelerate your career?

Responsibilities:

Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks

· Delivering and presenting proofs of concept of key technology components to project stakeholders.

· Developing scalable and re-usable frameworks for ingesting and enriching datasets

· Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times

· Working with event-based/streaming technologies to ingest and process data

· Working with other members of the project team to support delivery of additional project components (API interfaces, Search)

· Evaluating the performance and applicability of multiple tools against customer requirements

· Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Must have -

· Strong knowledge of Data Management principles

· 5 to 10 years of total years of experience

· Experience in building ETL / data warehouse transformation processes

· Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).

· Should have experience with MS SQL RDBMS and SQL Query Language

· Experience using Apache Spark and associated design and development patterns

· Microsoft Azure Big Data Architecture certification is an advantage.

· Hands-on experience designing and delivering solutions using Azure Storage, Azure SQL Data Warehouse, Azure Data Lake

· Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Terraform etc.

While meeting all the preferred qualifications is not required to apply for a position, it may give applicants a competitive edge. It is important to read a job posting carefully and to only apply if you feel that you meet the qualifications, both required and preferred.

Applying for a position without meeting the preferred qualifications may mean that your application is not even considered by the employer. In some cases, an applicant who meets all the required qualifications but only some of the preferred qualifications may still be contacted by the employer for an interview. However, it is always best to try to meet as many of the qualifications as possible.

Life at PureSoftware :

Equal Opportunity Employer:

PureSoftware is an equal opportunity employer and does not discriminate based on race, national origin, gender, gender identity, sexual orientation, disability, age, protected veteran status, disability, or other legally protected status. The company is committed to a diverse and inclusive workplace. Here, we embrace our differences and foster a culture of growth, high performance, and innovation.

Work-Life Balance:

We value work-life balance. Working at PureSoftware, it is not about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We care about your career growth.

Innovative, High-Performance Work Culture:

• Our team is dedicated to supporting new members. We have a broad mix of tenures and experience levels, and we focus on creating an environment that celebrates knowledge sharing and mentorship and gives individuals learning and development opportunities to steer their career growth. We strive to assign projects based on what will help each team member develop holistically and enable them to take on more complex tasks in the future.