Data Engineer

As a  Data Engineer your primarily responsible for maintaining and enhancing the Registry’s data acquisition, integration, and ETL pipelines in support of both operational and business intelligence data stores. The incumbent is responsible for applying diverse data cleansing and transformation techniques as well as the ongoing management and monitoring of all Registry databases. This will include addressing issues pertaining to the ongoing operations and optimization of the data environment including performance, reliability, logging, scalability, etc. You  will also provide support for the organizations database systems, warehouse, marts, and supporting applications.  

You will also lead the efforts to develop a unified enterprise data model for the organization. As a Data Engineer you will also design, develop, and maintain high-performance data platforms on premise and in Microsoft Azure cloud-based environments including leading the development of a data warehouse environment to support the Registry’s business intelligence roadmap. You will champion efforts that will ensure that the organization’s business intelligence applications remain relevant for use by internal business groups by actively participating in strategy and project planning discussions. Work collaboratively with Registry participants and internal support teams, identify and implement changes that improve system performance and the user experience.

Design, develop, and maintain the ETL pipelines using SSIS that standardized raw data from multiple data sources and optimize both the operational and dimensional/star schema data model necessary for transactional systems and business intelligence applications. Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions aligning to an overall data architecture. Extract, transform, and load data to and from various data sources including relational databases, NoSQL databases, web services, and flat files. Produce various technical documents such as ER diagrams, table schemas, data lineage, API documents, etc.

Provide leadership and oversight on database architectural design for existing systems including database administration, performance monitoring, and troubleshooting. Provide complex analysis, conceptualize, design, implement, and develop solutions for critical data-centric projects. Perform dataflow, system and data analysis, and develop meaningful and useful presentation of data in downstream applications. Plan and implement standards, define/code conformed global and reusable objects, perform complex database design and data repository modelling.

Monitor ETL processes, system audits, dashboard reporting, and presentation layer functioning and performance. Proactively identify and implement procedures that resolve performance and/or data reporting issues. Support the optimal performance of the organization’s data and BI systems. Monitor database performance, provide optimization recommendations, and implement recommendations. Follow the release cycles and implement on-time delivery of task assignments, defect correction, change requests, and enhancements. Troubleshoot and solve technical problems. Perform other responsibilities as assignment by management.

Requirements

• 3 years of relevant work experience in a data engineering role leveraging SQL, SSIS; including design and support of ETL routines that support the import of data from multiple data sources
  




• 2 years of experience with PowerBI
  




• 3 years of data warehousing experience including the design, development, and ongoing support of star or snowflake data schemas to support business intelligence applications
  




• 5 years of database administration or database development experience in a SQL or MySQL environment; knowledge of Microsoft technology stack; background in Azure Infrastructure as a Service environment desired
  




• Experience working with both structured and unstructured data
  




• Demonstrated understanding of Business Intelligence and data solutions including cubes, data warehouses, data marts, and supporting schema types (star, snowflake, etc.)
  




• Data modeling experience in building logical and physical data models
  




• Applied knowledge of Microsoft Security/Authentication Concepts (Active Directory, IIS, Windows OS)
  




• Strong technical planning skills with the ability to prioritize and multitask across a number of work streams
  




• Polished presentation skills; experience creating and presenting findings to executive level staff
  




• Strong written, verbal and interpersonal communication skills, with an ability to communicate ideas and solutions effectively
  




• Must be highly collaborative with the ability to manage and motivate project teams and meet deliverables
  




• Ability to build strong stakeholder relationships and translate complex technical concepts to non-technical stakeholders
  

• Experience with Data Warehouse is a plus
  




• Knowledge of SSRS is a plus