Welcome

Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein



Thursday, 4 June 2026

The Reality of Compliance in the Age of AI



Compliance used to be retrospective. Policies were written, audits were conducted and evidence was gathered after the fact to demonstrate that controls had been followed. That approach is no longer sufficient. AI has introduced a level of complexity where decisions are made faster, data is reused in ways that are difficult to track, and accountability becomes harder to define. Compliance cannot keep up if it remains a reactive process. It has to become something that is designed into how organizations operate.

The problem beneath the surface

Most organizations still treat compliance as a separate function. A team that interprets regulation. A set of policies that sit alongside operations. A series of controls that are checked periodically but the real challenge is not understanding regulation. It is applying it consistently across processes, systems, and increasingly, AI-driven outcomes.

  • What data can be used for training
  • How decisions are explained
  • Where sensitive information is retained or deleted

These are operational questions, not just compliance ones.

Where Purview comes in

Purview Compliance capabilities focus on managing these challenges in a structured way. Data lifecycle management defines how long data should exist and when it should be removed. Records management strengthens that by applying legal and regulatory context. Compliance Manager provides a framework to track controls and measure progress against requirements. More recently, these capabilities are being used to address AI-related concerns. Understanding data usage, managing retention, and demonstrating control are all foundational to responsible AI. The technology does not replace compliance thinking. It enables it to be applied consistently.

The technical layer that matters

Retention labels and policies are often seen as administrative tools. In reality, they directly influence how data is stored, preserved, or deleted across workloads. Records management introduces immutability and defensibility. Compliance Manager maps controls to regulatory standards, providing visibility into gaps and progress. These are not isolated features. They form a system where compliance is codified into policies that operate at scale.

Why this matters now

Regulation is evolving. The EU AI Act, data protection laws, and industry-specific requirements are all pushing organizations towards greater accountability. At the same time, AI is accelerating how data is used. This creates a tension. Organizations want to move quickly, but also need to demonstrate control. Manual processes cannot bridge that gap. Compliance has to become embedded. It has to operate continuously, not periodically.

The reality

In the age of AI, compliance is no longer about proving that controls exist. It is about proving that they are applied, monitored, and effective in a constantly changing environment. Purview provides the mechanisms to do this, but like governance and security, it depends on how it is used. Policies must reflect real business requirements. Controls must be implemented consistently. Ownership must be clear. Otherwise, compliance remains a reporting exercise rather than a capability.

References and learning

https://learn.microsoft.com/en-us/purview/compliance
https://learn.microsoft.com/en-us/purview/data-lifecycle-management-overview

Microsoft Announces Scout: An Always‑On Autonomous Agent for Work

Microsoft has unveiled Scout, its first Autopilot agent, an always‑on, autonomous digital assistant designed to work across Microsoft 365, proactively coordinating tasks, managing workflows, and keeping work moving even when you’re not in the loop. What makes Scout different is its ability to operate with its own identity, act within organisational policies, and build long‑term context through WorkIQ, learning how you work and what matters most. But beneath the excitement, there’s a deeper story for those of us working in data governance and Responsible AI.

Where Scout Meets Data Governance

Microsoft has been explicit: Scout is built with enterprise‑grade security, policy enforcement, and auditability from day one. Key governance‑aligned capabilities include: Policy‑constrained identity Scout acts only within the permissions and boundaries your organisation sets. Execution containers & OS‑level sandboxing  reducing risk when agents access files, run code, or interact with networks. Continuous policy conformance checks every action is validated against organisational guidelines, producing an audit trail. This is a significant shift: AI agents are no longer “black boxes” running in user sessions, they’re governed, monitored, and contained as first‑class enterprise actors.

Responsible AI: Built Into the Foundation

Microsoft has also published Responsible AI documentation for Scout, reinforcing that it is part of a broader commitment to safe, transparent, and accountable AI systems. 

Highlights include:
  • Responsible AI FAQs explaining how Scout works, what data it accesses, and how system owners can shape behaviour.  
  • Tiered permission systems for file access, shell commands, and browser automation.  
  • Human‑in‑the‑loop expectations and environmental considerations for deployment.  
This aligns Scout with Microsoft’s AI principles of fairness, reliability, safety, privacy, security, inclusiveness, transparency, and accountability.

Why This Matters

For organisations already investing in data governance, AI assurance, and operational Responsible AI, Scout represents a new category of enterprise agent:
  • Autonomous enough to reduce coordination overhead  
  • Governed enough to meet compliance and risk expectations  
  • Context‑aware enough to become a durable part of the digital workforce

This is the moment where AI agents stop being assistants and start becoming accountable digital colleagues  operating within the same governance frameworks as humans and systems.

Wednesday, 3 June 2026

Microsoft Build 2026: The Moment Governance Became the Bottleneck, Not Innovation

If last year’s narrative was about what AI can do, Microsoft Build 2026 marked a noticeable shift: the conversation has moved firmly to what organizations must control.

Across two days of announcements, Microsoft made one thing clear. The next phase of enterprise AI will not be defined by better models or more copilots. It will be defined by whether organizations can operationalise data readiness, governance, and trust at scale.

And that is where the most important announcements sit.

From “AI Features” to “AI Systems That Act”

The headline innovation at Build wasn’t just new models, it was the emergence of autonomous AI agents as first-class enterprise actors.

Microsoft introduced Scout, an always-on AI agent capable of continuously operating across enterprise systems, taking actions rather than waiting for prompts.
This marks a fundamental shift from assistive AI to operational AI, software that executes tasks, interacts with systems, and makes decisions within workflows. 

But this also introduces a new governance reality.

When AI moves from generating content to acting on behalf of a business, the questions change:

  • Who is accountable for the action?
  • What data did the agent access?
  • What policies constrained its behaviour?

Microsoft’s answer is not a single tool but an emerging governance architecture for agents.

Governance Is Now Part of the Platform (Not an Add-On)

Across the announcements, governance was not positioned as a compliance afterthought. It was embedded into the core platform.

Three developments stand out.

Agent identity, control, and auditability

Agents are now designed with their own identities, permissions, and audit trails that essentially are becoming governed entities within enterprise systems.
This is a critical shift: governance is no longer about users accessing data, but about non-human actors operating within policy boundaries. 

The rise of the agent control plane

With capabilities such as Agent 365 and broader governance frameworks, Microsoft is building what can only be described as a control layer for AI agents covering access control, visibility, monitoring, and compliance. 

This moves governance from static policies to continuous oversight of autonomous systems.

Built-in safety, evaluation, and testing

The introduction of evaluation frameworks like ASSERT (for testing AI behaviour against policy expectations) signals a shift toward engineering governance into the development lifecycle itself. 

This aligns closely with emerging standards (ISO/IEC 42001, EU AI Act), where governance is expected to be designed, evidenced, tested and not assumed.

Data Governance Quietly Took Centre Stage

While the headlines focused on models and agents, the more important story sits underneath: data is now the limiting factor for AI.

Microsoft’s investment in Fabric including a GPU accelerated data warehouse positioned as an execution layer for AI workloads reflects a deeper truth: organisations don’t lack AI capability, they lack AI-ready data environments. 

This reinforces a theme many of us have been seeing on the ground:

The challenge is no longer can we use AI?
It is can we trust the data, control its usage, and scale it responsibly?

Even outside the keynote announcements, updates across Microsoft Purview continue to evolve around:

  • data quality management,
  • data loss prevention for AI interactions,
  • and governance across expanding AI estates. 

Taken together, this signals a more mature positioning that data governance is not supporting AI, it is enabling it.

A New Stack: AI, Data, and Governance as One System

Perhaps the most important architectural shift is how Microsoft is framing the AI stack.

At Build 2026, governance was explicitly treated as a foundational layer alongside compute, models, and tools. 

This is subtle but significant.

Previously, governance sat outside the stack:

  • something imposed after deployment,
  • owned by risk or compliance functions,
  • often disconnected from engineering.

Now, governance is:

  • integrated into runtime environments,
  • embedded in agent frameworks,
  • and enforced through platform capabilities.

This is a move toward operational governance, not theoretical governance.

What This Means for Businesses

For organizations, these announcements are less about new features and more about a change in expectations.

AI adoption will be constrained by governance maturity

The organizations that succeed will not necessarily be those with the most advanced models but those with:

  • clear data ownership,
  • defined policies for AI usage,
  • and the ability to monitor and control AI behaviour continuously.

Governance becomes a cross-functional discipline

AI governance can no longer sit solely with data teams or compliance functions. It now spans:

  • data governance,
  • security,
  • enterprise architecture,
  • and operational risk.

Tools alone will not solve the problem

While Microsoft is building an increasingly comprehensive governance ecosystem, the platform assumes something critical:

Organisations already understand their data, risks, and policies.

In reality, many do not.

This is where the gap and the opportunity sits.

The Real Announcement wasn’t a Product

If you step back, the most important announcement at Build 2026 wasn’t a model, a Copilot update, or even an agent.

It was a shift in narrative.

Microsoft is signaling that:

  • AI is no longer experimental.
  • Agents will become embedded in everyday business operations.
  • And governance is now the primary barrier to scale.

In other words, we’ve moved from the innovation phase of AI to the industrialisation phase.

And industrialisation always introduces the same question:

How do you scale safely, consistently, and with accountability?

That is not a tooling question. It is a Data and AI governance question.

References

forbes.com  dqindia.co  theneuron.ai  microsoft.github.io  pulse2.com 

forbes.com  learn.microsoft.com  theneuron.ai

Tuesday, 2 June 2026

The Reality of Data Security in M365 (Purview Protection)



Data security has traditionally been viewed as a problem of access. Who can see what. Who can download it. Who can share it. In a world of structured systems and defined boundaries, that was enough. That world no longer exists. Data in M365 is fluid. It moves between emails, Teams chats, SharePoint sites, and endpoints. It is copied, embedded, summarised, and now increasingly, generated by AI. The idea that you can secure it by controlling entry points alone is no longer realistic. Data security has shifted from protecting locations to protecting the data itself.

The problem organizations are actually facing

Most organizations believe they have data security in place because they have policies but when you look closer, those policies are often disconnected from how data is used in practice. Labels are defined but not applied consistently. Data loss prevention rules exist but generate noise rather than insight. Users find workarounds because controls are either too restrictive or not aligned to real workflows. The result is a false sense of security. Controls exist, but coverage is inconsistent. Risks are identified, but not prioritised. Sensitive data continues to move, often without visibility.

What Purview is doing differently

Purview Protection capabilities bring together several controls that are often treated separately. Information Protection classifies and labels data, ideally at creation. Data Loss Prevention applies policies to control how that data moves. Insider Risk adds behavioural context, identifying patterns that indicate potential misuse or compromise. Individually, these are familiar concepts. Together, they form a model where protection is persistent and data-centric. Classification stays with the data. Policies follow it across services. Signals from usage and behaviour start to inform risk in real time. It is not just about blocking actions. It is about understanding how data is used and where risk actually exists.

The technical reality that matters

There is a level of technical depth that is often overlooked. Sensitivity labels are not just tags. They drive encryption, access control, and downstream policy enforcement. DLP is not just rule matching. It combines classification, conditions, and contextual signals. Insider Risk does not operate in isolation. It correlates activity across multiple workloads. These capabilities rely on integration. They rely on consistency. They rely on governance decisions being made upfront. Without that, the tooling becomes fragmented. With it, you start to see a unified security posture that is driven by data, not systems.

Why this matters now

The introduction of AI into everyday tools has changed the risk landscape. Content can be summarised, transformed, and shared at scale. Sensitive information can surface in places it was never intended to be. Traditional controls do not always detect these patterns because they were not designed for this level of fluidity. This is where data-centric security becomes essential. Not as an additional layer, but as the foundation for allowing organizations to use these tools with confidence.

The reality

Security is no longer about stopping access. It is about enabling the right use of data while reducing risk. Purview provides the controls to do this, but only when it is implemented as part of a coherent approach. Labels, policies, and signals must align. Business context must inform technical controls. Otherwise, organizations end up with visibility but no clarity, and policies but no control.

References and learning

https://learn.microsoft.com/en-us/purview/information-protection
https://learn.microsoft.com/en-us/training/paths/implement-data-loss-prevention/

An holistic view of how Microsoft Purview Connects to other tools in Microsoft Purview.



Monday, 1 June 2026

The Reality of Data Governance in 2026 (Purview Governance)

There is still a belief that data governance is something you implement. A programme. A tool. A project that runs for twelve months, delivers a catalogue, assigns a few owners, and quietly dissolves once the funding runs out. In 2026, that belief is not just outdated. It is actively holding organizations back. Data governance has become something else entirely. It is no longer a layer that sits on top of data. It is the condition that determines whether organizations can operate, scale, or even trust what they know. The shift is subtle, but critical. Governance is no longer about control. It is about confidence at scale.


A different kind of problem

Most organizations are not struggling because they do not have governance tools. They are struggling because they do not have governance embedded into the way data is created, moved, and used. The result is predictable. Data exists, but ownership does not. Definitions are documented, but not agreed. Catalogues are populated, but not used and AI initiatives start with optimism and quickly run into questions no one can answer.

  • What does this dataset actually represent
  • Who is accountable for its quality
  • Can we trust it enough to base decisions on it

These are not technical questions. They are governance failures.

Where Purview actually fits

Microsoft Purview, particularly the governance capabilities, is often positioned as a catalogue. A place to discover and classify data. That framing is too narrow. At its core, Purview Governance is about creating visibility, accountability, and context across the data estate. Scanning brings assets into view. Classification starts to describe them. Business glossaries and domains begin to connect them to meaning but the technology alone does not create governance. It exposes the gaps. If there is no ownership model, the catalogue becomes a list. If definitions are not agreed, the glossary becomes a dictionary with multiple interpretations. If governance is not embedded in delivery, the platform reflects fragmentation rather than resolving it. Used properly, Purview forces the right conversations. It highlights where business ownership is missing. It shows where critical data is unmanaged. It provides a structure to align people, process and technology.

Why this matters now

The pressure is not coming from governance programmes. It is coming from AI. Organizations are trying to move faster. They are trying to reuse data, combine it, expose it to models and automation. What they are discovering is that speed without control creates risk, and control without clarity creates friction. This is where governance has to evolve. Not as a retrospective exercise, but as something that is designed into the operating model from the start. Purview becomes valuable at that point, not because it catalogues data, but because it supports a model where governance is continuous, visible, and owned by the business.

The reality

In 2026, organizations that treat governance as optional will struggle to scale anything that depends on data. Those that embed it will not talk about governance as a separate function. It will simply be part of how they manage their products, their processes, and increasingly, their AI. The technology is ready. The frameworks are well understood. The challenge is no longer knowing what to do. It is choosing to do it properly.

References and learning

https://learn.microsoft.com/en-us/purview/data-governance
https://learn.microsoft.com/en-us/training/paths/manage-data-estate-purview/

For all 3 areas, see the full realities of data governance, data security and data compliance.



Sunday, 31 May 2026

When AI Becomes an Employee, Governance Becomes Strategy

 Two recent pieces got me thinking about where AI is really heading:

👉 AI in the agentic workplace (WEF)
👉 AI is becoming the new employee

Both challenge a core assumption many organisations are still holding on to:

AI is no longer just a tool.
It’s becoming part of the workforce.

The WEF describes AI as a new colleague, embedded into workflows, reshaping how work is done and how organisations are structured. The AI as employee view goes further positioning agents as digital workers that can own tasks, make decisions, and contribute to outcomes. There is a gap I don’t see enough people talking about are we accelerating adoption faster than we are defining governance.

If AI starts to behave like a workforce participant, then the questions shift:

  • What data is it allowed to access and under what controls?
  • How do we ensure decisions are explainable, auditable, and fair?
  • Who is accountable when an AI employee gets it wrong?
  • How do we assign roles, permissions, and boundaries to non-human actors?

This is where data governance and Responsible AI stop being supporting disciplines and become the foundation of the operating model. Because the future isn’t just AI-enabled teams, it’s human + AI workforce design:

  • AI agents operating across governed data domains
  • Decisions driven by data that must be trusted, lineage-tracked, and policy-controlled
  • Hybrid teams where accountability, not just capability, must be clearly defined

And this is the real shift:

  • From AI as capability → AI as organisational entity
  • From model governance → workforce governance
  • From policies on paper → operationalised controls across data, AI, and people

The organisations that get ahead won’t be the ones who deploy the most AI. They’ll be the ones who:

  • Treat AI access to data as a governed privilege, not an entitlement
  • Design AI roles with the same rigour as human roles
  • Embed responsible AI principles into day-to-day execution not just frameworks

Because if AI is becoming the new employee then governance is no longer optional. It’s how you stay in control.


References

https://www.weforum.org/stories/2026/01/ai-agentic-workplace-human-resources/ https://open.substack.com/pub/nidgguy/p/ai-is-becoming-the-new-employee?utm_campaign=post-expanded-share&utm_medium=web

assets.kpmg.com

Monday, 18 May 2026

Governing the agents not just the AI

The current wave of agentic AI is not just another iteration of automation, it is a shift from models that advise to systems that act. In the Fortune piece summarised via Yale Insights, the central risk is not capability but placement: where agents are deployed in the business and how close they operate to customers, decisions and trust. The “proximity framework” highlights that the closer an agent gets to irreversible, customer-facing decisions, the greater the governance burden becomes, with failures having disproportionate reputational impact. What is emerging consistently across follow-on work in banking, healthcare, retail and supply chain is that governance is lagging deployment, with organizations actively running agents across operations while still relying on fragmented or incomplete control models. This reinforces a point you often make in governance conversations: the problem is no longer whether AI works, but whether organizations can safely operationalise decision rights at scale. 

When you bring data governance into this, the conversation sharpens significantly. Multiple recent articles move beyond model governance and focus specifically on how agents access and use data, often autonomously and continuously. Agent Access Management reframes governance as a data problem, not just identity, because agents inherit permissions dynamically across APIs, workflows and services, often without visibility into what they can actually reach. Traditional access governance breaks here because it assumes static roles and human review cycles, whereas agents operate continuously and at machine speed, creating access patterns that are technically authorised but contextually inappropriate. This is why newer guidance emphasises data-aware controls, real-time monitoring and understanding not just who the agent is, but what data it is using and why. It aligns strongly with emerging audit expectations, where organizations must evidence which agents exist, what data they access, and how decisions are controlled and explained. 

What is becoming clear across the literature is that governance for agents is not an extension of traditional AI governance, it is a redesign of enterprise control models. Firms like IBM and McKinsey point out that governance needs to move from validating outputs to controlling actions, defining scope, ownership and accountability for autonomous decision-making. At the same time, platform and vendor ecosystems are converging on concepts like control planes, agent registries and data-centric governance layers to ensure visibility and enforce policy at runtime. The consistent thread across all of this is that trust in agentic AI is not built at the model layer, it is built at the data access and execution layer. That is where governance now has to operate, and it is where most organisations are still weakest. 

References

Fortune / Yale source 

Supporting governance and agentic AI articles

Agent governance frameworks and operating model shifts

Data access governance and agent-specific governance

Audit, compliance and enterprise deployment considerations