Blog

Gain control of your SharePoint Data

Most medium to large companies have a sizable Microsoft SharePoint space, containing thousands, if not millions of data files – but do you know what exactly is in them? In this post, we’ll lay out three core elements for gaining control of your SharePoint data, below, and most importantly why. Outlining the strategy and tooling…

Why fixing your data quality issues shouldn’t wait

In Gartner’s recent report on data quality, they listed the critical five things you should do to make your data complete, accurate, and fit for purpose. These are: Scope Governance Processes Roles & Responsibilities Technologies, with a very strong message to focus attention and energy on your Data Quality hotspots. However, the killer point for…

Is Data Governance at a crossroads, and does it need a “Data Mesh” refresh?

We’ve recently seen a trend in Data Governance with much debate over the differences between Data Governance and Data Management. Industry expert, Gartner, suggests that in 2025 some 80% of organizations seeking to scale their digital businesses will have failed because they do not take a modern approach to data and analytics governance (Gartner –…

Prefect: Should you utilise the next generation of data pipelining software?

What is data pipelining, and why does it matter? Data pipelining, or orchestration is an everyday activity performed by companies to move their data from one place, likely the primary storage location, to another, such as a cloud-based data lake, often including transformations during this process. Whilst this is a standard operational activity, the number…

What is Quality 4.0?

I am delighted that this week we can make more widely available the first publication on our leading-edge research project carried out for and with the CQI on Quality 4.0 (Q 4.0). In the July edition of Quality World, there was a cover feature – ‘Defining QUALITY 4.0.’ The editor Tracy Tyley and her team…

What If…? Self-doubt and The Elephant in the Room.

Anyone familiar with the TV programme Ru Paul’s Drag Race will recognise the saying “Remember if you can’t love yourself, how the hell are you gonna love somebody else?” All too often we beat ourselves up when we make mistakes and given the past eighteen months, we should more than ever, celebrate our successes and…

Replicating Data Warehouse with Databricks Lakehouse

Introduction In a recent post, we outlined what a Databricks Lakehouse encompasses and why you may want to utilise one rather than a Data Warehouse and/or Data Lake. Following that introduction, this post will walk through an example use case, including code, for how the Databricks Lakehouse replicates some common warehousing patterns while having the…

The Pro’s and Con’s of using Data Lakehouse

When using your Data Platform to improve your Business Intelligence with useful dashboards, and reports, you’ll more than likely want to use a Data Warehouse. Add on your data science builds and storing your raw data cheaply, plus adding a Data Lake just for good measure, and the costs soon start adding up. Running both…

How to align a data governance and data strategy roadmap

In this post, we expand on our earlier focus on ‘How to Build a Data Governance Program by Stealth: Introducing the Lighthouse Projects Concept‘ by exploring how to expand the reach and impact of Data Governance through alignment with a robust data strategy. Why the need for Lighthouse Data Governance? In the earlier ‘Data Governance…

Why bigger isn’t always better…. Maximising returns through cloud-based proof of concepts:

Part 1 – Starting out and getting over the first hurdle!  So, about ALL of that data you have…  Pushing data into the cloud was once seen as a skill confined to tech companies, who had either started with at least one foot in the door or had the skills readily available to make it happen. However,  it is now much more commonplace for organisations to want to lift and shift their data and operations…

The Use Case For Project Analytics

In this final article of the Project Analytics series, now that we’ve covered how to launch your Project Analytics capability, we explore what each category of users will make of their newly created capabilities now the skills, processes and technology are finally in place.  There are typically four basic use cases that we observe when building out…

The Four Phases of a Project Analytics Roadmap

In this article, we continue our discussion into the process of building out a complete Project Analytics capability for your major projects initiatives.    Last week, we explored the engineering architecture required for a modern Project Analytics capability. This week, we look at how to create a roadmap from your Project Analytics pilot into a production-ready solution that…