Data engineer

Entity:

Technology

Job Family Group:

IT&S Group

Job Description:

A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architecture such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and accessibility. They play a critical role in enabling the data-driven decision-making process by ensuring that data pipelines are robust, efficient, and scalable.

The Engineering and subsea team is undertaking a series of new projects in Palantir to sit along site a catalog of commercial products and products built on other platforms.  The successful candidate will be a data engineer with strong Palantir  Foundry experience across the full stack of Palantir capability from data , through ontology to UI.

What you will deliver 

• Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. 
• Implements and maintains reliable and scalable data infrastructure to move, process and serve data. 
• Writes, deploys and maintains software to build, integrate, manage, and maintain customer facing use cases
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp. 
• Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation), code reuse). 
• Adheres to and advocates for data engineering best practices (e.g. data modeling, pipeline idempotency, operational observability)  
• Responsible for deploying secure and well-tested software and data-assets that meet privacy and compliance requirements; develops, maintains and improves CI / CD pipeline, 
• Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments. 
• Actively contributes to improving developer velocity. 

What you will need to be successful (experience and qualifications) 

Essential 

• Hands on experience Palantir Foundry development including good exposure to the ontology framework, and experience developing applications which extend the capabilities of the foundry platform
• Hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments 
• Hands on experience in at least one programming language (C#, Python, or TypeScript, JavaScript, React Native) developing cross-platform solutions.
• Hands on experience with Foundry including ontology delivery, data integration, secure data handling,pipeline building using pipeline builder and code repository (PySpark), Workshop Design
• Hands-on experience in data engineering and data pipelines
• Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability 
• Experience implementing large-scale distributed systems in collaboration with more senior team members 
• Knowledge and hands-on experience in technologies across all data lifecycle stages 
• Strong verbal and written communication skills 
• Continuous learning and improvement mindset 
• BS degree in computer science or related field or equivalent knowledge and experience 

About bp 

Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! 

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. 

Travel Requirement

Up to 10% travel should be expected with this role

Relocation Assistance:

This role is eligible for relocation within country

Remote Type:

This position is not available for remote working

Skills:

Agility core practices, Agility core practices, API and platform design, Cloud Platforms, Collaboration, Communication, Configuration management and release, Continuous deployment and release, Creating a high performing team, Digital Project Management, Documentation and knowledge sharing, Emerging technology monitoring, Facilitation, Information Security, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Problem Solving, Relational Data Modelling, Risk Management, Scripting, Secure development, Service operations and resiliency, Software Design and Development, Solution Architecture {+ 6 more}

Legal Disclaimer:

We are an equal opportunity employer. We do not discriminate on the basis of protected characteristics like race, religion, color, sex, national origin, sexual orientation, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.