About the job

Summary

As a Lead Data Engineer you will lead a dynamic and growing team within the Digital function during a period of rapid growth and change.

You and your team will be an important part of the technology supply chain serving BDUK’s technical needs. You will work with a variety of stakeholders across BDUK and DCMS as well as our external partners and suppliers. As we grow you will be key in helping to promote a culture of continuous improvement whilst helping to ensure BDUK runs a stable and reliable set of services and applications.

Job description

Leading the development, delivery and maintenance of data products and services for BDUK;

Designing and implementing the dataflows required to connect BDUK operational systems, data for analytics and BI systems;

Designing, building and deploying information and data management process-flow systems, working collaboratively with delivery partners to manage process flow implementations;

Maintaining data quality and the capability to deliver management information to BDUK stakeholder groups, both internal and external;

Leading the development & progression of the data roadmap, including the identification of improvements, both strategic and technical procedures across the data development lifecycle and ensures that the team adheres to these; and

Overseeing the data architecture and data governance framework within BDUK.

Responsibilities

Expertise in integrating and separating data feeds to map, produce, transform and test new data products;

Ability to motivate and lead a multi-disciplinary, virtual team;

Expertise in exposing data from systems, linking data from multiple systems and delivering data services;

Experience with Cloud based architecture and deployment (preferably Google Cloud Platform);

Experience of at least one RDBMS system, as well as cloud repository databases such as Google’s BigQuery;

Able to apply a range of techniques for data profiling and source system analysis from a complex single source;

Able to bring multiple data sources together in a conformed model for analysis;

Experience of building data models and data pipelines using various design patterns;

Strong understanding of building/Managing APIs, Data Transfer/sync, FTP and hands on expertise of SQL;

Stakeholder management skills with the ability to translate technical concepts into non-technical language;

Experience of workflow management tools (e.g. Cloud Composer or Airflow);

Understanding of security, accessibility and version control and familiarity with a range of coding tools and languages (Python & PHP desirable);

Understanding of data privacy and ethical considerations;

Excellent communication skills, both written and verbal; and

Championing diversity and inclusion as well as experience of creating diverse and inclusive teams that are motivated; and inspired to work together to achieve a common objective.

Behaviours

We'll assess you against these behaviours during the selection process:

• Leadership
• Communicating and Influencing
• Making Effective Decisions
• Seeing the Big Picture