Principal Data Engineer

• You may be a fit for this role if you: Have agency: feel empowered to influence outcomes, rather than being passive. 

• Are open-minded, curious, and resourceful 

• Are passionate about/stay current with modern technologies 

• Solve problems systematically and transparently 

• Share ideas, solicit/integrate feedback, design and solve collaboratively 

• Take a software engineering approach and demonstrate automation and security mindsets 

What you might work on: 

As a Principal Data Engineer at Dimensional, you will have the opportunity to understand the users’ needs and solve problems like database and schema design and engineering, ETL pipelines, APIs, and microservice design and engineering. 

• Accountable for the design, engineering and ongoing operations of robust, secure, and maintainable data architectures, pipelines, and services. 

• Collaborate with data stewards, database administrators, platform engineers, developers, and site reliability engineers to develop and launch solutions for data ingestion, validation, quality control, integration, storage, management, and delivery.  

• Independently work with clients to transform business objectives into technical designs, applications, and solutions. Participate in and contribute to the design of agile teams and ceremonies. 

• Stay current on technology trends by learning and evaluating modern technologies. Advise business clients on technical capabilities as a data service provider / expert. 

• Participate in code reviews and contribute to making continuous improvements to the team’s dev ops processes.  

• Provide mentorship to junior team members and provide strategic input to senior management across various business and technology units. 

The successful candidate will be self-motivated and have a strong drive for learning and self-improvement while working within an engineering focused delivery team with cross-team departmental collaboration. 

Qualifications:  

• Bachelor’s degree in a technical field or equivalent practical experience 

• Deep expertise in designing and implementing various stages of Data lifecycle (from ingestion to distribution) using Snowflake as the core platform. 

• 10+ years of experience with implementation of ETL/ELT pipelines, data governance, data quality controls, data version control, meta data management, and reporting analytics using cloud data technologies. 

• Experience messaging and streaming platforms such as Kafka, RabbitMQ, or cloud-based messaging technologies. 

• Experience with Python or equivalent dynamic languages 

• Experience with C#, Java Typescript, or equivalent static languages 

• Experience with Relational and Non-Relational databases and related schema design and development 

• Working knowledge of Observability and DevOps concepts, tools, and continuous delivery pipelines. 

• A deep understanding of cybersecurity best practices and a demonstrated ability to integrate best practices into development activities 

Preferred Competencies:  

• Interest and ability to learn other coding languages as needed 

• Ability to write in English fluently and idiomatically 

• Advanced degree in a technical field or equivalent experience in engineering or practical experience 

• Experience with agile/scrum methodologies 

• Financial services industry experience 

• Testing competencies with Test Driven Development, Behavioral Driven Development 

Experience with any of the following: 

• Redis, PostgreSQL, MongoDB, SQL Server 

• DBT, FiveTran etc. 

• Numpy, Scipy, Pandas 

• Airflow, Kafka, AWS, serverless/microservice architecture