Welcome

Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein



Showing posts with label Fabric Databases. Show all posts
Showing posts with label Fabric Databases. Show all posts

Wednesday, 19 November 2025

What is new for Databases and Fabric at Ignite

There is significant news on the database front. Microsoft is unifying its data platform by deeply integrating its databases with Microsoft Fabric, creating a seamless, AI-powered data estate.













Unified Data Estate with Microsoft Fabric

  • Microsoft Fabric now acts as a unified platform that integrates Microsoft’s operational databases (like Azure Cosmos DB, Azure SQL, and PostgreSQL) with analytics and AI tools.
  • This integration enables real-time insights and governed data sharing across operational and analytical systems without complex ETL pipelines.

Real-Time Analytics with Synapse Real-Time Intelligence

  • The new Synapse Real-Time Intelligence in Fabric allows streaming data from operational databases to be analyzed instantly.
  • This supports use cases like fraud detection, predictive maintenance, and personalized recommendations.

Built-in Governance and Security

  • Microsoft Purview is embedded in Fabric, ensuring data lineage, access control, and compliance across the entire data estate.
  • This helps organizations meet regulatory requirements while maintaining agility.

AI-Ready Data for Copilot and Custom Models

  • With this integration, data from operational systems becomes AI-ready by default, enabling seamless use with Microsoft Copilot and custom AI models.
  • This supports natural language querying, automated insights, and generative AI applications.

Fabric IQ 

Fabric IQ is Microsoft Fabric’s new semantic intelligence layer that transforms raw data into business-aware insights by embedding meaning, relationships, and operational context directly into the data platform. This announcement marks the moment Microsoft Fabric evolves from a unified data platform into a unified intelligence platform. It created a shared, real-time understanding of the business. It is designed to solve a core challenge in enterprise AI: AI agents can read data, but they often lack the business context to interpret it meaningfully. Fabric IQ introduces a semantic layer that maps data to real-world business concepts like customers, flights, or inventory, rather than just tables and columns



Fabric IQ introduces a semantic intelligence layer that gives both people and AI the same deep business context your experts rely on. It connects data, meaning, and action through:
  • Ontology - A shared business model built with no-code visual tools
  • Semantic Model - Trusted BI definitions extended into operations & AI
  • Graph Engine - Multi-hop reasoning across connected business systems
  • Data Agent - Virtual analysts that answer questions using real business semantics
  • Operations Agent - Autonomous agents that monitor, reason, and act in real time



Bi-Directional Data Movement

  • Fabric supports bi-directional data movement between databases and the analytics layer, enabling write-back scenarios like updating customer profiles or triggering workflows.

Microsoft Databases and Microsoft Fabric: Your unified and AI-powered data estate

SQL Database in Microsoft Fabric

SQL Database in Microsoft Fabric is a cloud-native, developer-friendly transactional database built on the same engine as Azure SQL Database, designed to integrate seamlessly with the broader Fabric ecosystem.

SQL database in Fabric is built on 3 important pillars: Simple, Autonomous & Secure, and Optimized for AI. It is now genernally available. 

Announcing SQL database in Fabric (Generally Available)







Friday, 29 November 2024

The year ahead for SQL Server 2025

In the session SQL Server 2025 An enterprise AI-ready database platform the  core features for the next version of SQL Server were shared being based on

  • AI built-in
  • Best in class security and performance
  • Fabric and Azure Arc connected. 

SQL Server 2025 is built from the ground to cloud with AI  ready applications. SQL Server 2025 is to have 

  • Vector store - native vector data type and DiskANN index
  • Model Management - model interfaces ground to cloud using REST
  • Embeddings built-in - text chunking and built-in embedding generation
  • Simple semantic searching - vector distance and vector search
  • Framework integration - LangChain, Semantic Kernel, Entity Framework Core









All changes made for SQL will be deployed across all deployment options and all versions. 




It is integrated with Microsoft Fabric



The year ahead for SQL Server: Ground to cloud to fabric

Responsible AI is embedded and available on premises or in the cloud.

There is now SQL database in Fabric



Azure Arc extends to Azure services to SQL Server anywhere to streamline migrations to Azure. 



Watch more about the latest release from Joe Sack, Erin Stellato and Bob Ward. So many innovations in this version of SQL Serer it changes what options are available for use.

Thursday, 28 November 2024

Microsoft Ignite 2024 keynote

The Microsoft Ignite keynote in Chicago November 2004 looked at adoption, extensibility and ROI. Copilot is the UI for AI. There were many announcements as expected for Microsoft Ignite

Copilot Action - regain focus time and simplify you workday Read More: aka.ms/CopilotActions

Agents in Microsoft 365 Read more:  aka.ms/AgentsinM365

Copilot studio - Autonomous agents and thirty Party Agents. Importantly Copilot Analytics including 

  • Copilot Dashboard
  • Business Impact Report
  • Advanced Insights

to measure AI impact on your business. This impact report will help drive valuable insight to gain business value. It shows how AI is driving revolutionary productivity and changing business.

Read More: aka.ms/CopilotAnalytics



It was exciting to see the announcement of SQL Server 2025


Apply for the preview for the enterprise AI-ready database

Fabric Databases Accelerate app innovation with an AI-powered data platform with Fabric Databases .

It is a new class of cloud databases


















New centralized management and governance controls and risk and safety evaluation for images with Azure AI Foundry announced




hashtag

These governance controls are in private preview
  • create AI reports to govern AI apps and models
  • view and manage key subscription details
  • simplified setup of hubs, projects and resources

The breadth of Azure AI model was shown with their being offerings from a wide collection of frontier and open models.  Being around 1800 models currently.

Risk and safety evaluations for images to assess AI models and apps for harmful outputs. Looking to 
  • Understand frequency and severity of risks
  • Streamline risk assessment processes
  • Measure impact of targets mitigations
Data Governance also took a central conference place because in the age of AI, Data Governance takes on an even more critical, central & important role. Watch the session 'Secure and govern your data estate with Microsoft Purview' BRK317 that covers the new security and governance capabilities. 

Successful AI transformation starts with a security-first approach. The new capabilities announced 

Prevent data oversharing and detect insider risks in Microsoft 365 Copilot
  • Data Security Posture Management (DSPM) for AI, formerly known as Microsoft Purview AI Hub, is now generally available
  • Microsoft Purview DLP for Microsoft 365 Copilot, now in public preview. It enables processing files based on their sensitivity label to restrict Microsoft 365
  • Detect and investigate risky AI usage for Microsoft Purview Insider Risk Management and Communication Compliance in public preview
Secure and govern custom AI with new capabilities in Purview, Defender, and Azure AI
  • Public preview of Microsoft Purview DSPM for AI, Insider Risk Management, and data compliance controls for agents  in Copilot Studio
  • AI-Security Posture Management (AI-SPM) in Defender for Cloud is now generally available
  • New centralized management and governance controls and risk and safety evaluation for Azure AI Foundry 
And last but not least  AI regulations preparation, such as the EU AI Act with new capabilities in Purview Compliance Manager and Azure AI.
  • There are 4 new generally available AI compliance assessment  including the EU AI Act, NIST AI RMF, ISO 42001, and ISO 23894. 
  • AI reports in Azure AI in private preview