Welcome

Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein



Showing posts with label Data Strategy. Show all posts
Showing posts with label Data Strategy. Show all posts

Friday, 5 June 2026

Seen but Not Heard: The Age of Data Governance

There’s a phrase I remember being told as a child  “seen but not heard.”

At the time, it meant quiet compliance. Something present, something acknowledged, but not something that shaped the room or influenced what happened next. Strangely, that’s exactly how organizations have treated data governance for years. It has always been there, in the background. Policies exist, frameworks have been written, roles have been defined. If you look hard enough, every organization can point to where governance sits. It is visible. It is documented. It is technically present but it hasn’t truly been heard. It hasn’t influenced how systems are designed, how teams deliver, or how decisions are made in the way it should. Instead, governance has often been something that follows behind delivery as a correction, a control, a necessary inconvenience once the “real work” has already been done. That made sense, once but it doesn’t any longer.



What has changed is not governance itself, it is the world around it. We now operate in organizations where data is not a by-product of activity; it is the thing everything depends on. Strategy is built on it, operations are driven by it, and increasingly, decisions are delegated to systems that rely entirely on it. There is no part of a modern organization that sits outside of data anymore and yet, governance is still too often treated as if it does. That tension is becoming impossible to ignore because when every system depends on data, every issue becomes a governance issue. When numbers do not align between reports, when teams cannot agree on definitions, when ownership is unclear, when trust in outputs begins to erode these are not technical failures in isolation. They are symptoms of something deeper: a lack of embedded governance. You can see this play out repeatedly. Organizations invest in platforms, they modernise architectures, they implement analytics solutions, they adopt AI. Each initiative is presented as progress, and in isolation, it often is. But without governance woven into the fabric of these initiatives, complexity accumulates rather than resolves. Data spreads, inconsistency grows, and the ability to explain or trust what is being produced gradually diminishes. Governance, in those moments, has been seen but it was never allowed to shape the outcome.

The emergence of AI has brought this reality into sharper focus. For years, organizations could tolerate a degree of inconsistency in their data. It caused frustration, inefficiency, and occasionally risk, but it remained manageable. AI does not allow for that tolerance. It amplifies whatever it is given. Good data becomes insight at scale. Poor data becomes risk at scale. There is no neutral outcome. The old saying “garbage in, garbage out” still applies, but it now applies faster, at greater scale, and with far more impact than before. When decisions begin to be influenced or even made by systems fed on ungoverned data, the consequences are no longer contained within individual processes. They affect entire organizations. At that point, governance is no longer a supporting capability. It becomes the condition for whether anything works at all.

This is why the idea that governance can be added later no longer holds. It is not something that can sit alongside delivery or follow it. Governance determines what “good” looks like before anything is built. It defines ownership, establishes meaning, sets expectations, and ensures consistency. Without it, delivery moves forward, but coherence does not and that is the subtle but critical shift that is still being missed. We are not entering a stage where governance becomes more important as a standalone discipline. We are entering a stage where governance becomes inseparable from everything else. It is not another workstream to manage it is part of how every workstream operates. Every technology solution carries assumptions about data. Every integration defines how data flows. Every report reflects decisions about meaning, quality, and trust. Every AI model relies on choices about what data is used and how it is interpreted. In all of these cases, governance is already present. The difference is whether it has been made explicit, intentional, and embedded or whether it remains invisible until it fails.

One of the reasons organizations struggle with this shift is that governance has historically been framed in the wrong way. It has been positioned as a control mechanism, something that restricts or slows progress. It has been documented extensively, but lived infrequently. It has often been assigned to a function rather than understood as a shared organizational responsibility. As a result, it has been treated as optional in practice, even when it is mandatory in principle but when governance is embedded properly, it does not slow organizations down. It removes uncertainty. It allows decisions to be made with confidence because there is clarity around ownership, meaning, and quality. It reduces rework because expectations are clear from the outset. It enables innovation because it provides the guardrails that make experimentation safe. In other words, it makes progress sustainable.

The irony is that most organizations are already feeling the consequences of not doing this, even if they do not describe it in those terms. The questions that surface in meetings about which version of the truth to trust, about who is responsible for a dataset, about whether something can be used safely or compliantly are all governance questions. They just are not recognised as such and because they are not recognised, they are not addressed systematically. Instead, they are solved locally, temporarily, repeatedly. Governance remains visible in theory, but unheard in practice.

We are now at a point where that is no longer viable. If data is the thing that everything depends on, then governance must be the thing that everything contains. Not as an overlay, not as an afterthought, but as a standard, embedded part of how organizations operate. This is the age of data governance — not because governance is new, but because the absence of it is no longer survivable. The organizations that recognise this will not be the ones with the most advanced tools or the largest data estates. They will be the ones that understand their data well enough to trust it, control it, and use it consistently across every part of the business. They will be the ones that stop simply seeing data governance, and finally start listening to what it has been telling them all along.

Wednesday, 12 November 2025

From Steam to Silicon to Sentience: Four Industrial Revolutions and the Fragile Future of AI

The story of human progress is punctuated by revolutions, not just in technology, but in how we think, organize, and trust. From the steam engines of the 1840s to the generative models of the 2020s, each wave has promised liberation and delivered disruption. Today, as AI surges toward ubiquity, we must ask: what have we learned from past revolutions, and what must we safeguard before the bubble bursts.



Four Revolutions That Changed Everything

There are four revolutions that resulted in significant change where we can learn from the affects to help the AI revolution progress unhindered.

Era

Catalyst

Impact

Risk

Industrial Revolution (c. 1760 – 1840s)

Steam power, mechanization

Mass production, urbanization, labour displacement

Exploitation, unrest (e.g. Plug Plot Riots, 1842)

Digital Revolution (1950s – 1990s)

Mainframes, UK computing pioneers, PCs

Automation, global communication, software economies

Surveillance, fragmentation, digital exclusion

Cloud Revolution (2000s – 2020s)

Virtualization, SaaS, mobile-first

Scalable infrastructure, remote work, data centralization

Vendor lock-in, opaque governance, cyber risk

AI Revolution (2020s –)

Foundation models, generative AI

Cognitive automation, new interfaces, synthetic creativity

Hallucinations, bias, job loss, trust collapse

 During the industrial revolution there was a deep industrial economic depression. The Plug Plot Riots were a wave of industrial action and disturbances across Lancashire, Cheshire, and Yorkshire, triggered by severe wage reductions (often 20-25% in the cotton and coal industries). Many workers aligned with the Chartist movement advocating for political reform, responded by "plugging" mill boilers, removing drain plugs to flood engines and halt production which forced factories to close.   The Plug Plot Riots of 1842 led to some improvements for workers, notably the prevention of further wage cuts and the eventual passage of the Factory Act 1844, which introduced limited reforms. It introduced a reduction in working hours for women and children, some safety regulations in factories and a modest step toward better labour conditions.

The second revolution of computing was not just technical. It redefined abstraction, logic, and control. From the UK’s early computing pioneers to the rise of PCs, it laid the groundwork for cloud and AI. Yet it also introduced new vulnerabilities: fragmented standards, digital inequality, and the erosion of analogue memory.

Cloud as the Bridge: Infrastructure to Intelligence

Cloud computing connected digital and AI with its abstracted hardware, centralized data, and the capabilities to scale with ease. But as Satya Nadella emphasizes in his annual letter and Microsoft’s 2025 report, innovation without strategic purpose is fragile. Microsoft’s Secure Future Initiative and Quality Excellence Initiative reflect a shift: AI must be built on trust, not just talent.

Brad Smith’s AI Diffusion Report warns that AI is spreading faster than any prior technology but unevenly. The Global South, non-English languages, and underrepresented communities’ risk being left behind.

Data: The Fuel, the Flaw, the Future

AI’s power is unprecedented and has the power to improve or destroy depending on the algorithm development but also on the state of data. Poor quality, biased, or ungoverned data leads to hallucinations, misinformation, and systemic risk. As the BBC’s article on AI hallucinations shows, even the most advanced models can confidently fabricate facts, undermining journalism, science, and public trust. From the simplest things I have seen AI fabricate data, which is written so well, to the untrained eye it could be believed. Once the data is triangulated the output can be trusted. However, the data sources quality, the prompts and data that is behind paywalls will influence the outcome.

This is not a glitch it is a consequence of probabilistic systems trained on imperfect inputs. Without rigorous data governance, provenance tracking, and human oversight, AI becomes a mirror of our worst assumptions.

When the Bubble Bursts: Coping with the AI Comedown

Every revolution has its reckoning. The Plug Plot Riots of 1842, the dot-com crash, and the decline of post-industrial towns all reveal the cost of overhyped promises and underprepared systems. When the AI bubble bursts whether through regulation, disillusionment, or economic correction, organizations with strong data foundations, ethical frameworks, and human-centred design will endure.

Those who chased novelty without governance will falter.

Satya Nadella’s mantra is “thinking in decades, executing in quarters” is more than a business strategy. It’s a survival imperative. The AI era demands long-term vision grounded in short-term accountability. That means:

- Investing in data quality and lineage as core infrastructure

- Embedding responsible AI principles into every product and process

- Preparing workers for augmentation, not just automation

- Designing for resilience, not just scale

Conclusion: From Revolution to Renaissance

The Industrial Revolution reshaped labour. The digital revolution redefined logic. The cloud revolution scaled infrastructure. AI is now rewriting cognition. but without trust, transparency, and governance, even the most powerful tools will falter. As the socio-technical divide deepens and ecological systems strain, the cost of inaction grows, and we risk accelerating collapse socially and ecologically.

The disruption from AI is only just beginning. As Business Insider quoted, “Elon Musk said AI will make desk jobs feel like when workers used to make calculations by hand before the computer age.” This echoes the upheaval of 1842, when industrialisation redefined labour.

If we want AI to be a renaissance, not a reckoning, we must treat data as infrastructure, governance as strategy, and human ethics as non-negotiable. The future isn’t just what we build; it’s what we’re willing to steward.

We must draw a line: to protect data, embed meaningful guardrails, and confront the human cost of displacement. That means planning not only for the jobs we lose, but for the ones we must invent. It also means addressing the widening continental divide in AI development and its cascading impact on the environment and global economy.

References

'It's going to be really bad': Fears over AI bubble bursting grow in Silicon Valley 

https://www.bbc.co.uk/news/articles/cz69qy760weo

Satya Nadella annual letter: Thinking in decades, executing in quarters

https://www.microsoft.com/investor/reports/ar25/index.htmlhttps://www.linkedin.com/pulse/my-annual-letter-thinking-decades-executing-quarters-satya-nadella-7orpc?utm_source=share&utm_medium=member_android&utm_campaign=share_via

Brad Smith https://aka.ms/AIDiffusionReport

Elon Musk says the AI 'supersonic tsunami' will eliminate desk jobs 'at a very rapid pace'

https://www.businessinsider.com/elon-musk-ai-supersonic-tsunami-job-displacement-future-joe-rogan-2025-11

 Transparency: Written with the help of Copilot.

Tuesday, 12 August 2025

Introducing the CODEX Framework

The Cadence Alpine framework was created from rigorous academic research undertaken to understand best practices usage of data by Dr Victoria Holt FBCS. It was created before researchers had the option of using agentic AI. With the new Microsoft Researcher agent 'it helps you tackle complex, multi-step research at work, delivering insights with greater quality and accuracy than previously possible'. It was also created before 16 May 16, 2025 when 'OpenAI launched Codex, a new fully agentic AI coding assistant built into ChatGPT. Unlike traditional code autocomplete tools, Codex goes beyond being just a smart editor. Codex is OpenAI's series of AI coding tools that help developers move faster by delegating tasks to powerful cloud and local coding agents.'

The CODEX framework was named in 2017 based on transition and change into the digital age.


From the PhD Storybook

Cadence Alpine’s Strategic Compass for Data and AI Maturity

The CODEX is Cadence Alpine’s guiding framework. A strategic compass that helps organizations navigate the evolving terrain of data and AI. It is designed to assess maturity, uncover blind spots, and chart a path toward clarity, resilience, and innovation.








The CODEX Framework (2017)

CODEX in Practice

Together, these five Alpen Themes:  Control, Control of Operations, Data, Expediently and X (Unpredictable Events) form a dynamic map, not a static checklist. They help Cadence Alpine, and its partners assess where they stand, where they’re vulnerable, and where they can lead.

•       The CODEX framework isn’t a one-time climb. It is a cycle of elevation. Organizations revisit each layer as they grow, recalibrate, and lead. It is adaptive, shows emergent properties and can help with complex or chaotic business that are affected by environmental changes.

•       It enables the mindset of controls for data governance

•       It is in the right place for EIM and EDM to start management of data assets

•       It helps to transform the Executive mindset

•       To stop unknown destruction of data and AI decisions

•      To identify the hidden cost of data with poor data quality, ineffective decision making, out of data and inconsistent and duplicate data. In addition these compliance failures can mount

•       Increase ROI by reducing inefficiencies

•       Enables a strong Data base for intelligent foundation of AI, analytics and governance

Each of its five Alpen Themes represents a vital elevation in the landscape of intelligent operations. Each Alpen Theme has many Subalpine Elements which enable the breadth of complexity to be examined. These are:

Control (Business)

Focus: Strategic alignment, governance, and stakeholder clarity

Purpose: Ensures that data and AI initiatives are rooted in business vision, ROI, and ethical control.

Key Themes: Stakeholder mapping, governance frameworks, cultural alignment, KPI integration

“This is the summit where business vision meets operational reality.”

Control of Operations

Focus: Technical execution, system resilience, and process integrity

Purpose: Maintains control over infrastructure, applications, and workflows to ensure reliable delivery.

Key Themes: Security, cloud architecture, orchestration, documentation, implementation

“The ridgeline where systems must hold firm under pressure.”

Data

Focus: Data quality, architecture, governance, and ethical stewardship

Purpose: Builds a foundation of trustworthy, accessible, and responsibly managed data.

Key Themes: Lineage, ownership, availability, responsible AI, metadata, cost control

“The bedrock beneath every intelligent decision.”

Expediently

Focus: Agility, learning, and adaptive intelligence

Purpose: Enables rapid response, shared understanding, and modular thinking across teams.

Key Themes: Microlearning, business glossaries, agile pods, architectural flexibility

“The switchbacks that allow us to move swiftly without losing balance.”

X (Unpredictable Events)

Focus: Resilience, foresight, and strategic adaptability

Purpose: Prepares the organization to absorb shocks, pivot under pressure, and lead through ambiguity.

Key Themes: Scenario planning, crisis communication, regulatory agility, thought leadership

“The weather system we must read, not resist.”

The strategic benchmark shows the business alignment index.

















CODEX Business Alignment Index

The CODEX Ascent Is Iterative.

Philosophical View in Action

The CODEX enables the positioning across four forward-looking dimensions: Human in the Loop, Understanding Societal Impact, Economic Impact, and Learning Intelligence. This reflects how the company sees itself within each domain, based on its strategic framework and operational ethos.











Strategic Positioning Map

Each dimension is explained









Strategic Positioning Map Explained

A current positioning and aspirational direction are recorded each time the CODEX is run and mapped against other businesses in the same sector.

In Summary the CODEX is a strategic compass for navigating the evolving terrain of data and AI, guiding organizations through five Alpen Themes: Control, Control of Operations, Data, Expediently, and X (Unpredictable Events).

It enables businesses to assess maturity, uncover blind spots, and elevate their operational intelligence through iterative ascent and not a one-time climb.

Each theme contains Subalpine Elements that examine complexity across governance, agility, resilience, and ethical stewardship, forming a strong foundation for AI, analytics, and executive decision-making.

CODEX also positions organizations across four dimensions: Human in the Loop, Societal Impact, Economic Impact, and Learning Intelligence ensuring that intelligence grows responsibly and adaptively.

By identifying hidden costs, preventing destructive data practices, and aligning with EIM and EDM principles, the CODEX transforms executive mindset and increases ROI through strategic clarity and control.