About the job

Summary

This role is working within the Central Digital and Data Office (CDDO) who are the leaders of the Digital, Data and Technology profession across government. It sets the aspiration and strategy for digitisation and builds capability so that government is equipped with the skills needed to succeed in the internet age. CDDO designs and implements standards to systems and services that are delivered in the right way.

Our work in CDDO is user-focused, dynamic and forward-looking - making our organisation an exciting and innovative place to work.

We're looking for a Senior Data Engineer who has working-level expertise of integrating large

volumes of related data from a mix of various external sources, and maintaining a single source of truth accessible via API.

The UK Public Sector depends on internet domain name spaces such as “.gov.uk”, and the

Domains Team’s vision is that these name spaces remain stable, trusted, well managed and

resistant to compromise.

This is a fascinating area of work because it brings together the need for technical and cyber

expertise with business transformation where branding, government policy and law all play a part.

Job description

As the Senior Data Engineer in the Domains team you will be working to the Domains Product

Manager, and you will be responsible for the data that helps to achieve the vision, and in particular helps public sector organisations know who owns what, and ensures that it stays under the control of its rightful owners.

You will be working with members of the Domains team as well as external resources and senior

government stakeholders.

You will be responsible for defining, developing, implementing, and extending the data model. You will also be responsible for maintaining and operating the databases in the live system. You will be responsible for a data solution that:

• represents information received from third party and in-house tools and sources in ways that best support the work of the team

• is highly responsive to new requirements

• ingests and processes new data in agreed timeframes

• handles unexpected data formatting and edge cases well

• allows us to switch between different third-party sources that represent the data differently if necessary

• allows us to simultaneously use data from different third-party sources that may appear contradictory

• builds a historic record of the data that can be easily retrieved, but balances storage cost against value

• is accessible to third parties via API or similar.

Responsibilities

The ideal person will have the following skills:

• data analysis and synthesis. You know how to undertake data profiling and source system analysis and can present clear insights to colleagues to support the end use of the data

• data modelling. You understand the concepts and principles of data modelling and can produce relevant data models across multiple subject areas. You know how to reverse-engineer data models from a live system. You understand industry-recognised data modelling patterns and standards and when to apply them. You can compare and align different data models

• data integration design. You know how to select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions. (Relevant skill level: practitioner)

• problem resolution (data). You know how to respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services and identify trends to resolve problems. You can determine the appropriate remedy and assist with implementation of it as well as preventative measures

• programming and build (data engineering). You know how to use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate

• testing. You can review requirements, specifications and define test conditions. You can identify issues and risks associated with work while being able to analyse and report test activities and results