Have you been instructed to deliver a data maturity assessment for government (DMAG), but don’t know where to start? Not to worry – we’re here to help! This blog will help you get stuck in, outlining all the need-to-know information so you can tackle this task successfully.
In launching the DMAG, Megan Lee Devlin, the CEO of the Central Digital and Data Office (CDDO), stated, “Permanent Secretaries, Chief Digital and Information Officers, and Chief Data Officers across government have endorsed this important tool and committed to using it in a core part of their organisation within the first year.”
The expectation from the Cabinet Office is for wide adoption across the public sector. However, the DMAG maturity framework is also freely available and potentially suitable for wider use.
What is Data Maturity Assessment?
A data maturity assessment evaluates an organisation’s data strategy, policies, and capabilities to determine its level of data maturity. It helps in understanding how well an organisation manages its data and identifies areas for improvement. The assessment is crucial for developing a robust data management strategy and enhancing overall data governance.
What is the DMAG Framework?
The DMAG framework is comprehensive for a data maturity assessment. This will build a picture of data maturity across a department or organisation, but it takes some getting to grips with!
In summary, there are 97 assessment rows across 10 topics of data maturity. Each row is also aligned to a cross-cutting ‘theme’. Each row has a detailed description of what would score between a Level 1 (Beginning) and Level 5 (Mastering).
As this is a qualitative framework, each row must be assessed and judged, rather than calculated. Overall, this builds a picture of data maturity across an organisation’s data ecosystem rather than providing a single ‘score’. This step is often a prerequisite to building a data management strategy or refining a roadmap.
When you’re attempting a comprehensive assessment like the DMAG, it really pays to break things down and take them one at a time.
What are the Key Benefits of Data Maturity Assessment?
Conducting a data maturity assessment offers several key benefits:
- Improved Data Management: Identifies strengths and weaknesses in data practices, leading to better data management strategies.
- Enhanced Decision-Making: Provides insights that help make informed decisions based on reliable data.
- Increased Efficiency: Streamlines data processes, reducing redundancy and improving operational efficiency.
- Regulatory Compliance: Ensures that data practices meet regulatory requirements, reducing the risk of penalties.
- Strategic Planning: Supports the development of a clear roadmap for data improvements aligned with organisational goals.
- Cultural Shift: Promotes a data-driven culture, improving data literacy and engagement across the organisation.
From our experience, these are the six key steps to delivering the DMAG:
Understand the Framework
Get to grips with the intricacies of the DMAG and you’ll be able to articulate the assessment to set yourself up for success.
Focus Your Assessment
Shape the assessment to match your organisation’s function and objectives.
Balance and Target Your Assessment Methods.
Target how engagement should be made with specialist and non-specialist stakeholders.
Run the Assessment
Conduct the assessment thoroughly. Validate results with a knowledgeable party within the organisation.
Communicate the Results
Provide a clear ‘so what’ to accompany the results.
Define Forthcoming Activities and Objectives
Communicate the agreed commitments that will be undertaken to drive improvements.
Understanding the Framework
If you are responsible for delivering the DMAG, it is important to take the time to understand it. Doing this ahead of delivery will ultimately set you up for success.
Then, you’ll be able to discuss it with the rest of your organisation, many of whom may not encounter maturity assessments in their day-to-day roles. Getting your team’s understanding is equally important so that they feel included throughout the process.
You’ll also understand which data practices assessed would be most interesting to view in detail from your organisation’s perspective, either from corporate priorities or operational challenges.
The GOV.UK site (Data Maturity Assessment for Government) provides great insights into how this has been created and the intended cross-government use.
Focus Your Assessment
As per the guidance, there is no need to hit all 97 DMAG rows. At least 40 rows are required for a full assessment.
To narrow this down, we advise that the rows included should be those aligned to either:
- The department or organisation’s objectives, sector, or environment you are working in.
- The assessment should be balanced to ensure good coverage for each topic and theme, which will add robustness to it.
So, if you’re working with particularly sensitive data, we suggest including most, if not all criteria from ‘Protecting your data’.
In this example, you may wish to reduce the number of rows assessed from ‘Engaging with Others’.
Balance and Target Your Assessment Methods
The assessment should take into account specialist and non-specialist views. Surveys provide a great method for rapid assessment and canvassing opinions from a large group. Significant effort should be put into rewording a survey so non-data specialists can understand it while staying true to the DMAG.
Interviews and workshops can also be included. Typically, these will support the DMAG scoring and provide further insight into user issues and data needs across the organisation. Whilst this isn’t included in the assessment, it can be used when the results are published.
Understanding your department or organisation will inform you on how to deliver the assessment. For example, ensuring that workshops are safe for people to give honest feedback.
Regarding the assessment, it makes sense to plan out which assessment method should be used for each row. Building in multiple assessment methods for rows is ideal. However, this will increase the scope of your work!
Certain rows will suit different assessment methods. For example, with row number 62, ‘Acquiring existing data in the right way’, it would not be expected that an end user of an analytics platform (a data consumer) would be aware of the status of the data pipelines required to provide the data from the source system.
In this scenario, a targeted interview with a data engineer would likely be more appropriate. For other rows, such as 1. ‘Making data available for those who need it’, it is important to have a range of responses to balance whether user needs are met.
Run the Assessment
It is important to conduct the assessment row-by-row, record the evidence used and how the decision has been arrived at. Decisions should be made based on what is typical and usual. Throughout the evidence gathering, the extremes can often be drawn out. If there is contention, the DMAG guidelines advise defaulting to the lowest maturity level.
The results should then be further validated. This avoids any potential bias in the assessment and gives certainty to your current maturity level.
Communicate the Results
The results should be presented back to internal stakeholders. It will be important to reintroduce the DMAG at this stage, such that the audience understands how the results have been presented.
There is an important step, which is to define the ‘so what?’ around the results.
Ask yourself:
- Are the results fit for the purpose of our organisation?
- Would improved results support us in delivering our objectives?
- Are there limitations faced by staff due to gaps in the data maturity?
- Are there opportunities to provide a better service with enhanced data capability?
When delivering the results, it’s vital to give context, and additional information or quotes that have been collected provide valuable insight. This builds the rich picture of data maturity and, ultimately what the case for change is as an organisation. If actions have been agreed as a result of the DMAG, these should be communicated alongside the results. If actions are yet to be agreed, commit to a timeframe to provide these. This supports engagement and takes stakeholders on the journey of improving the data maturity.
Define Future Activities and Objectives
At the time of writing, the DMAG is still within its first year of release and may be refined in years to come.
We suggest building the majority of your objectives at the Topic and Theme level, in case any future changes are made to individual rows.
If you want to achieve buy-in for your recommendations, it’s vital to clarify the business benefit gained through improved data maturity. Often, efficiencies of effort, avoidance of regulatory penalties or increased revenues are cited.
There may be other cultural benefits, such as improving data literacy across the organisation, which are not as clearly tied to increased revenues or reduced costs, but these are still of great value to your organisation.
The next steps are to put your plans into action and conduct another assessment in another 12-18 months.
If you’re looking for help delivering a data maturity assessment for government (DMAG), please drop us a line at stuart.benzies@theoaklandgroup.co.uk.
