Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein

Saturday 18 November 2023

Microsoft Fabric is Generally Available

I watched the session 

Make your data AI ready with Microsoft Fabric and Azure Databricks

Jessica Hawk, Amir Netz, Arun Ulagaratchagan, Patrick Baumgartner, Profile picture of Kristen Christensen, Justyna Lucznik

'Bring your data into the era of AI with Microsoft Fabric, a powerful all in one AI powered analytics solution for enterprises that covers everything from data movement to data science, real time analytics and business intelligence. Learn how Azure Databricks and Microsoft Fabric seamlessly work together to offer customers a modern, price performant analytics solution that helps teams turn data into a competitive advantage.'

The discussion centred around the general availability of Microsoft Fabric. Below are are few slide images from the presentation.

Here is some more information about the changes.

Prepare your data for AI innovation with Microsoft Fabric—now generally available

Microsoft Fabric, explained for existing Synapse users

Thursday 16 November 2023

Microsoft Ignite 2023

An exciting introduction to Microsoft Ignite November 15 - 17, 2023. Two themes that I am excited about are the AI and Microsoft Fabric capability. 

Microsoft Ignite 2023: AI transformation and the technology driving change

The full list of changes at Microsoft Ignite are listed in the Microsoft Ignite Book of News.

In the main keynote Satya announced over 100 changes. A few of the announcements discussed in the keynote are mentioned here:

Azure Maia - The Microsoft Cloud accelerator optimized for LLM training and inference

Azure Open AI Service  updates

  • GPT-4 Turbo - Preview
  • GPT-4 Turbo with Vision - Preview
  • DALL-E 3 - Preview
  • Fine Tuning - Preview

Model catalog - New

  • Stable Diffusion
  • Code Llama
  • Mistral 7B
  • NVIDA Nemotron-3 8B

Models as a Service - announcing

  • Ready to use APIs
  • Hosted finetuning
  • Integrated with leading LLM tools

Phi-2 - Announcing

  • Built by Microsoft Research
  • 2.7 billion parameters
  • Common sense, language understanding, and logical reasoning

The Phi-2 model is changing the game in artificial intelligence (AI) and it is designed to make machines think more like humans and do it safely.

Azure AI Studio - Preview
  • Unified platform
  • Hybrid and sematic search
  • Full development lifecycle
  • Extends to Windows
  • Safe and Responsible AI
The Copilot stack is evolving with greater functionality.

Microsoft Fabric is now generally available, a data platform for the era of AI.

Azure AI Search - Deliver accurate, hyper-personalized responses in your Gen AI applications

There was also announcement of Mesh on Microsoft Teams being generally available. 

  • Copilot and avatar
  • Immersive spaces
  • No-code editor
  • Copilot and 3D space

Then finally something different Azure Quantum Elements - purpose built to accelerate scientific discovery.

PASS Community Summit 2023 Keynote 1

The PASS Data Community Summit 2023 global data conference is happening in Seattle between 14-17 November 14-17 2023.  

The first keynote 'Limitless growth, limitless opportunities: Data and innovation in an AI world' was given by  Shireesh Thota. He started talking about new technologies and how they offer limitless potential with AI, Generative AI and Real-time capabilities.  The limitiless growth with Azure and those SQL databases: SQL Server, Azure SQL, Postgres, CosmosDB and MySQL. These offer limitless scale, flexible tools, Built-in AI, Performance and Guaranteed availability. 

There are celebrations a foot due to SQL Server on Windows reaching 30 years old this year. SQL Server 2022 is the fastest adopted version of SQL Server with growth on both Windows and Linux. He also mentioned SQL Server enabled by Azure Arc with that cloud manageability for managing your entire SQL Server estate. Announcements were made

Discussions moved to Azure SQL and the family of SQL cloud in edge databases. A further announcement was made about the Azure SQL Managed Instance feature wave , that is now generally available. Azure SQL Managed instance has a free offer in preview for 12 months of free managed instance, available soon.

 What's new in Azure SQL Managed Instance?

They talked about that Cloud Modernization Journey: Evaluate, Optimize, Migrate and Modernize with ease. 

Another announcement Azure SQL Database Hyperscale will be same price as commercial OSS databases – General Available mid December.

Some further to announcements were shared

  • Azure Cosmos DB for MongoDB vCore – Generally Available
  • Vector Search in Azure Cosmos DB for MongoDB vCore – Generally Available 
  • Natural language queries for Azure Cosmos DB – Public Preview
  • Azure Database for PostgreSQL Extension for Azure AI – Preview

Then concluding with the database of the future will be autonomous and intelligent, developer friendly, cost efficient, and mission critical by default.

Wednesday 15 November 2023

Microsoft Cloud Innovation and Security Summit

I had the privilege to present at the The Form Rooms on Tuesday 14 November 2023 at the Microsoft Cloud Innovation and Security Summit run by Cloud Direct.  

The Forms Rooms is on a quiet street in London’s chic Covent Garden that was once a historic Victorian school that has been lovingly restored. 

My session was on 'The disruptive power of data and AI'.  About how Generative AI, Microsoft Fabric and Data Governance are the talk of the town, but without the building blocks of good quality, secure, accessible data, innovation in business is stunted. 

The talk covered how Data & AI are providing a catalyst for innovation addressing  

  • Where is Data & AI tech going
  • Why having an agile data strategy and data governance adoption path is important. 
  • How data can be a catalyst for innovation 

In today’s world technology changes and enhancements are accelerating at speed. Developments from the 1960’s took decades to move into the modern workplace. But now we see these coming to the fore with the democratisation of technology.  We moved from the 

1970s where Codd invented the relational database

To the 1990s when ‘Big Data’ became a term to address the ever-increasing large volume of data, with discussions of volume, velocity , variety and veracity. Here we saw the mention of that ever-important reference to the quality of data. 

With that grew the ‘Internet of Things’ processing more data from sensors, devices and communication networks. 

Behind the scenes world leading database researchers meet every few years to discuss the impact on practice, challenges and emerging applications. The latest output was documented in the Seattle report in 2019. One of the areas discussed was the fact that it was impractical to continue to move volumes of data between systems. We see this fundamental change in Microsoft Fabric.

And today, it is all about ‘Generative AI’ and what it can create...

There were many really interesting sessions during the conference with Innovation, AI and Security intertwined. 

Data Toboggan Alpine Coaster 2023 Agenda

Announcing the Data Toboggan - Alpine Coaster Agenda for APAC, EMEA and AMER

Sign up for Data Toboggan Alpine Coaster
Event: Friday 24th November

Friday 10 November 2023

Microsoft Ignite November 2023

Microsoft Ignite is next week. There are lots of exciting sessions.

Online: November 15–16, 2023 PT | In Seattle: November 14–17, 2023 PT

The headline Experience AI transformation in action, online from anywhere. The session catalog is packed full of exciting content and the agenda states whether the session will be recorded or not , so helpful when planning your schedule. A few key sessions to watch.

Keynote: Microsoft Ignite opening

Wednesday, November 15 5:00 PM - 5:45 PM Greenwich Mean Time

Satya Nadella will share how Microsoft is creating new opportunity across our platforms in this new era of AI.

Keynote: Becoming an AI-Powered Organization with Microsoft Copilot

Wednesday, November 15 5:45 PM - 6:35 PM Greenwich Mean Time

Join Rajesh Jha, along with Jared Spataro and other leaders to see how Microsoft Copilot will unlock productivity and transform business process for everyone across functions and industries.

Keynote: AI transformation for your organization with the Microsoft Cloud

Thursday, November 16 5:00 PM - 6:15 PM Greenwich Mean Time

Scott Guthrie and other leaders will share how the Microsoft Cloud is uniquely positioned to help our customers transform by building AI solutions and unlocking data insights using the same platform and services that power all of Microsoft’s comprehensive solutions.

Keynote: The Future of Security with AI

Thursday, November 16 6:15 PM - 7:00 PM Greenwich Mean Time

While the new era of AI presents unprecedented opportunities to elevate human potential, it also ushers in a new set of unknowns and risks. In this session, Charlie Bell and Vasu Jakkal will share how Microsoft is delivering AI for security with Security Copilot, and how we are enabling organizations to secure and govern AI with new capabilities.

Keynote: Inside Microsoft AI innovations with Mark Russinovich

Friday, November 17 8:30 PM - 9:30 PM Greenwich Mean Time

Join Mark Russinovich, Azure CTO and Technical Fellow, for an in-depth exploration of Microsoft's AI architecture. Discover the technology behind our massive supercomputers used for foundational model training, efficient infrastructure for serving models, sustainable datacenter design, AI-aware resource management and scheduling, GPU usage optimization techniques, and advancements in confidential computing to safeguard data during processing.

Make your data AI ready with Microsoft Fabric and Azure Databricks

Wednesday, November 15 7:45 PM - 8:30 PM Greenwich Mean Time

Bring your data into the era of AI with Microsoft Fabric, a powerful all in one AI powered analytics solution for enterprises that covers everything from data movement to data science, real time analytics and business intelligence. Learn how Azure Databricks and Microsoft Fabric seamlessly work together to offer customers a modern, price performant analytics solution that helps teams turn data into a competitive advantage.

Upgrading your data estate to Microsoft Fabric and getting started Q&A

Thursday, November 16

9:30 PM - 10:15 PM Greenwich Mean Time

Looking to get started with Microsoft Fabric, but don't know where to start? Join our product experts to discuss everything from basic set up steps to migrating to Fabric from Synapse to starting a POC with departments where you want to gain traction quickly.

PASS Data Community Summit 2023

PASS Data Community Summit have revealed that they will be livestreaming 16 key sessions for free. LIVE from #PASSDataSummit 2023 in Seattle November 14-17.  From #AzureSQL, #SQLServer to #DevOps and #ChatGPT, we've got it all covered.  More details can be found in their blog post  on how to join the livestream. 

All timings are in Pacific time, and the sessions are:

Wednesday November 15

8.15-9.30am – KEYNOTE: Limitless growth, limitless opportunities: Data and innovation in an AI world

9.30-10.15am – break

10.15-11.30am – COMMUNITY: What’s New in Azure SQL and SQL Server, Data Exposed Live

11.30am-12pm – break

12-1pm – LUNCHEON: Database DevOps Luncheon: All you Ever Wanted to Know but were too Afraid to Ask

1-1.30pm – break

1.30-2.45pm – MICROSOFT: Data Warehousing Simplified in Microsoft Fabric

2.45-3.15pm – break

3.15-4.30pm – COMMUNITY: Automating Database Deployments using Azure DevOps

4.30-4.45pm – break

4.45-6pm – AWS: 3-Step Guide to Modernize SQL Server to PostgreSQL

Thursday November 16

8.15-9.30am – KEYNOTE: The New Database Landscape – Revealing Shifts and Charting the Next Horizon

9.30-10.15am – break

10.15-11.30am – REDGATE: Redgate Product Launch: Transform your software delivery with Test Data Management

11.30am-12pm – break

12-1pm – LUNCHEON: Women in Technology: Got your Back: Finding Allies at Work

1-1.30pm – break

1.30-2.45pm – INTEL: How Microsoft & Intel Power Your SQL Server environments

2.45-3.15pm – break

3.15-4.30pm – COMMUNITY: Easy Enterprise Integration with Azure PaaS Services

4.30-4.45pm – break

4.45-6pm – COMMUNITY: Accelerated Database Recovery – A Deep Dive Behind the Magic

Friday November 17

8.15-9.30am – KEYNOTE: AIOps and ChatGPT: Prepare to Ride the Next Wave

9.30-10.15am – break

10.15-11.30am – REDGATE: Cloud Migration: The Good, the Bad, and How to Plan for Success

11.30am-1.30pm – break

1.30-2.45pm – MICROSOFT: What You Should Know About Always On Availability Groups

2.45-3.15pm – break

3:15-4:30pm – MICROSOFT: Everything You Need to Know About Data Virtualization in SQL

Lots of amazing sessions to watch.