Big Data Engineer

Job Title: Big Data Engineer/Developer

Location: Pune

Experience Range: 5–9 years

• Tech Stack Must Have : Hadoop, Python, Spark, Unix, Oracle.


• Good to Have : Apache NiFi, Ozone, Cloud technologies.

Job Overview Responsible for the analysis, design, development, and delivery of software solutions. This role involves defining requirements for new applications and customisations while adhering to MasterCard standards, processes, and best practices. The candidate will develop, customise, and test applications to integrate with MasterCard specifications and provide leadership, mentoring, and technical guidance to team members.

Key Responsibilities (Major Accountabilities) Solution Design & Development

• Plan, design, and develop technical solutions to meet business requirements in alignment with MasterCard standards and best practices


• Lead day-to-day system development and maintenance activities to meet service level agreements (SLAs)


• Deliver high-quality, cost-effective, and innovative solutions with faster time-to-market Full SDLC Ownership


• Take accountability for the full Software Development Life Cycle (SDLC), including:


• Requirements documentation and use-case definition


• System design and technical artefacts


• Test strategy and test design


• Performance benchmarking


• Release and deployment planning


• Contingency and rollback plans


• Feasibility studies and effort estimation Production Support & Maintenance


• Perform system maintenance and production incident management


• Identify root causes and drive remediation


• Participate in on-call support (pager rotation) Architecture & Technology Leadership


• Select appropriate technical frameworks and delivery methodologies


• Maintain solution and technology roadmaps


• Contribute to defining standards, processes, and best practices


• Research and evaluate emerging technologies and frameworks Innovation & Vendor Collaboration


• Participate in Proof of Concepts (PoCs)


• Support evaluation and selection of vendors, technologies, and frameworks


• Collaborate with vendor teams for product support Knowledge Sharing & Mentoring


• Conduct knowledge sessions (e.g., brownbag sessions)


• Ensure knowledge transfer from vendors to internal teams


• Mentor team members and provide technical training Quality & Process Excellence


• Promote and follow Quality Assurance (QA) and Quality Control (QC) processes


• Ensure adequate test coverage across:


• Unit Testing


• System/Integration Testing


• Performance Testing


• Conduct reviews throughout SDLC:


• Requirements, Design, Code, and Security Reviews


• Identify opportunities for process improvement and efficiency Team Coordination


• Coordinate offshore development activities


• Manage day-to-day team execution and delivery

Education

• Bachelor’s degree in:


• Information Systems


• Information Technology


• Computer Science


• Engineering


• Or equivalent work experience

Experience

• 4–6 years of relevant experience in software engineering.


• Tech Stack - Must Have : Hadoop, Python, Spark, Unix, Oracle.

• Good to Have : Apache NiFi, Ozone, Cloud technologies.

• Experience in delivering secure solutions (Financial Services domain preferred)


• Strong understanding of software engineering concepts and methodologies

Skills & Competencies Technical & Professional Skills

• Strong understanding of software development practices and SDLC


• Ability to work with multiple frameworks and technologies


• Awareness of secure coding and financial domain standards Behavioural Competencies


• High energy, detail-oriented, and proactive mindset


• Strong ownership, initiative, and self-motivation


• Ability to work effectively under pressure Communication & Collaboration


• Strong verbal and written communication skills


• Excellent interpersonal and stakeholder management skills


• Ability to work in a matrix-based, geographically distributed team Learning Agility


• Willingness to learn new technologies and take on challenges


• Adaptability in a fast-paced, evolving environment

Additional Expectations

• Demonstrate MasterCard core competencies


• Actively contribute to team growth and organisational best practices