Tuesday, 8 April 2025

The 2025 AI Index Report

The eighth edition of the AI Index report is out. The 2025 Index is the most comprehensive to date as AI’s influence across society, the economy, and global governance continues to intensify

In the report it covers 

  • in-depth analyses of the evolving landscape of AI hardware 
  • novel estimates of inference costs 
  • new analyses of AI publication and patenting trends. 
  • fresh data on corporate adoption of responsible AI practices
  • expanded coverage of AI’s growing role in science and medicine. 





Monday, 7 April 2025

Why Fabric’s New Health & Quality Capabilities Matter More Than Ever

At FabCon this year, Microsoft doubled down on something many of us in data governance have been saying for a long time: trustworthy data doesn’t happen by accident. It is engineered, monitored, and continuously improved. The newly announced health, quality, and observability capabilities in Microsoft Fabric signal a decisive shift away from reactive firefighting and toward proactive, platform‑level assurance.

For organisations scaling AI, analytics, and operational data products, this matters. Data Quality and Observability are no longer “nice to have”; they are the minimum viable conditions for responsible, repeatable, and compliant data use.

Below is a concise, actionable breakdown of what these new capabilities mean—and how to turn them into immediate value across your estate.

1. Treat Data Health as a First‑Class Operational Signal

Fabric’s expanded health management capabilities give teams something they’ve historically lacked: a unified, platform‑native view of data system health. Instead of stitching together logs, alerts, and manual checks, you now get:

- Integrated telemetry across pipelines, workloads, and storage  

- Early‑warning indicators for degradation, drift, or failure  

- Operational insights that connect system behaviour to business impact  

This elevates data health from a technical afterthought to a governance‑aligned operational metric. For leaders, it means you can finally answer the question: “Is our data estate healthy enough to trust today’s decisions?”

Action: Establish a weekly “Data Health Review” ritual—short, structured, and tied to business outcomes. Treat it like you would a security posture review.

2. Use Data Quality as a Contract, Not a Cleanup Exercise

The new Fabric capabilities reinforce a principle I advocate in every governance programme: quality must be defined, measured, and enforced at the point of creation.

With Fabric’s enhanced quality tooling, teams can now:

- Define expectations (validity, completeness, timeliness) as part of the data product  

- Monitor quality continuously, not periodically  

- Surface issues directly to producers and consumers  

- Build trust signals into downstream AI and analytics workloads  

This shifts quality from reactive cleansing to proactive assurance , a contract between producers and consumers.

Action: Publish a lightweight “Quality Contract” template for all critical data products. Keep it simple: purpose, expectations, checks, and escalation paths.

3. Make Observability the Backbone of AI Governance

As AI workloads scale, observability becomes the difference between responsible innovation and uncontrolled risk. Fabric’s new observability features support:

- Traceability from source to model  

- Lineage‑aware debugging  

- Impact analysis when upstream changes occur  

- Evidence trails for audits, compliance, and Responsible AI reviews  

This is not just operational hygiene, it is AI governance in practice. You cannot assure fairness, accuracy, or safety in AI systems without deep visibility into the data that feeds them.

Action: Integrate Fabric observability outputs into your Responsible AI lifecycle checkpoints—especially model validation and change‑control reviews.

In summary the message from FabCon is clear: health, quality, and observability are now strategic capabilities, not technical chores. For organisations building modern data estates and especially for those embracing AI, where these features are the foundation of trust.









Sunday, 6 April 2025

Microsoft AI Skills Fest

The Microsoft AI Skills Fest is starting from 8 April 2025 to 28 May 2025 to enhance your AI skills and unlock the future. From experiential content to hackathons, there is a lot of opportunity to learn at all levels. 

Register today: https://msft.it/6042qSzcE






Tuesday, 1 April 2025

Microsoft Community Fabric Conference 2025 announcements

There were lots of announcements during the FabCon 2025 conference. Here are a few to catch up on. The main Microsoft blog post can be read here: Fueling tomorrow’s AI with new agentic capabilities and security innovations in Fabric

Fabric Data Factory

Fabric Data Factory enables data ingestion through applying data transformations, and orchestrating different data-related activities for modern data management architectures. There were many new features added such as 

  • General availability for CI/CD capabilities in Data Factory 
  • SPN auth available for pipeline CRUD APIs to secure API apps without needing to use their user token when using the REST API.
  • Lakehouse connector to read delta tables, being able to use the information from the deletion vectors to exclude deleted records.
  • Support for column mapping, and automated auto-creation of tables with new schemas.



Further reading Fabric Data Factory: What’s New and Latest Roadmap

There were also many product improvements and features for Mirroring in Fabric

Mirroring in Fabric – What’s new

Migration Assistant for Fabric Data Warehouse

A really exciting announcement to help migrate from Azure Synapse Analytics was unveiled. This Migration Assistant for Fabric Data Warehouse will soon be in preview! The Migration experience is built natively into Fabric and enables the seamless transition from Azure Synapse Analytics (Data Warehouse) to Microsoft Fabric.

Migration Assistant for Fabric Data Warehouse (Preview)

Copilot for Data Engineering and Data Science

There is a new version of Copilot for Data Engineering and Data Science, a next-generation AI-powered assistant designed to elevate data analysis and coding experience. 

Further reading Enhancing AI productivity in Fabric notebooks with Copilot updates

Copilot F2 and above SKUs 

This is great news for customers on F2 and above SKUs that they will have access to Copilot, Fabric data agents, and more.

hashtag

Azure AI Foundry

Organizations can use Azure AI Foundry to connect customized, conversational agents, created in hashtagMicrosoft Fabric.

Microsoft Purview

There are several new innovations in hashtagMicrosoft Purview for protected, AI-ready data
1. Enhancing Microsoft Purview Data Loss Prevention (DLP) support for lakehouse in Fabric to help prevent sensitive data loss by restricting access
2. Expanding DLP policy support for additional Fabric items such as KQL databases and Mirrored databases to show users notification through policy tips when they are working with sensitive data
3. Microsoft Purview for Copilot in Fabric
4. Data observability, now in preview, within Microsoft Purview Unified Catalog

These are a few of the announcements that were of particular interest to me but there were a lot of announcements showcasing the sheer volume of change and growth of Microsoft Fabric.