Middle Big Data Engineer

WE ARE

At SoftServe, we are advisors and providers who operate on the cutting edge of technology. With you, we set goals and reach them to grow better together, learning from both successes and mistakes. We are a team of thinkers and makers in more than 60 offices in 16 countries, true professionals and good people, who like what we do and do it well.

We are the Big Data & Analytics Center of Excellence, data consulting, and data engineering branch of SoftServe. Starting as a group of 3 enthusiasts back in 2013, almost 200 Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others. Our client for this project is an online travel company for consumer and small business travel. They own numerous well-known vacation rental online marketplaces.

The team specializes in creating and managing data engineering pipelines within live hybrid environments. Their areas of responsibility encompass data modeling, database design, operations, data analysis, ingestion, and integration.

IF YOU ARE

• Experienced in building and maintaining at least one data engineering pipeline or data product in production environments within a public or hybrid cloud infrastructure
• Proficient in data modeling, database design, data architecture principles, and data operations
• Good at SQL optimization, adept at making data pipelines efficient by optimizing SQL queries for enhanced performance
• Competent in performing data analysis, data ingestion, and data integration tasks
• Skilled in Big Data technologies such as Hadoop, MapReduce, Hive, Spark, Metastore, Kafka, Flink, etc.
• Knowledgeable in programming languages, particularly Java and Scala
• Capable with hands-on experience using orchestration tools like Airflow
• Familiar with working with APIs and NoSQL databases like Cassandra, which would be considered an added advantage

AND YOU WANT TO

• Build pipelines that consume data from data lakes to serve ML models
• Make pipelines efficient and optimize SQL
• Work with high-loaded streaming environments
• Be part of a team of data-focused engineers dedicated to continuous learning, improvement, and knowledge sharing every day
• Work with a cutting-edge technology stack, including services from major cloud providers that are at the forefront of innovation and may not yet be generally available
• Engage with customers from diverse backgrounds, ranging from large global corporations to emerging crypto startups preparing to launch their first product.
• Be involved in the entire project lifecycle, from initial design and proof of concepts (PoCs) to minimum viable product (MVP) development and full-scale implementation

TOGETHER WE WILL

• Dive into the cutting-edge technology stack, including major cloud providers' services which are not generally available yet
• Support your technical and personal growth — we have a dedicated career plan for all roles in our company
• Explore new technologies, build internal prototypes, and share knowledge with the SoftServe Big Data Community
• Upskill with full access to Udemy learning courses
• Pass professional certifications, encouraged and covered by the company
• Assimilate best practices from experts while working in a team of top-notch engineers and architects
• Collaborate with world-leading companies and attend professional events
• Have a chance to address different business and technology challenges, engage in challenging projects and top-notch technologies, and drive multiple projects and initiatives as a part of the Center of Excellence