Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein

Wednesday 26 April 2023

Modern Analytics and Governance at Scale

Microsoft have released a white paper talking about Analytics and Governance (MAG) at Scale to learn how to successfully build an end-to-end analytics ecosystem aligned to datamesh, datafabric, and datahub. Starting with an enterprise data strategy in place, this enables your organization vision and roadmap to accelerate value creation drawing on your data. This lays the groundwork for building the three fundamental pillars of Modern Analytics and Governance (MAG) at Scale: 

  1. Enterprise Data Governance: This includes lineage, classification and policy. Then data ordering and moving to rapid access to data
  2. Data Management Foundation: Lakehouse as a foundation includes automated data management, ingestion, standardization, quality, metadata registration and access provisioning
  3. Domains and Data Products: Autonomous domains provisioned, analytic federations , ingestion and curation for analytics patterns

This is a transformative approach to the modern analytics ecosystem. Capabilities enabled at scale are

Including data governance in solutions has these objectives

  • Discover and describe data
  • Automatically secure data
  • Democratise data access
  • Provide data leaders an understanding of their data

To move towards that enterprise data governance state it is important to build a data foundation . The whitepaper mentions four ways to start with this

  1. Creating metadata
  2. Mapping data assets
  3. Cataloging data assets
  4. Automating governance and security

The paper goes on to share an implementation plan and much more for Microsoft Purview . 

Tuesday 18 April 2023

MVP Summit 2023

It is MVP Summit this week. 

It is week to catch up with friends and learn. I hope everyone at MVP Summit has fun, learns a lot, provides useful feedback and is understanding. Thanks to the team for organising the event. Sad I am not there but I see my name on the board. #MVPBuzz

Monday 10 April 2023

Data Toboggan - Cool Runnings 2023

Submit a session for Data Toboggan – Cool Runnings, our 3rd summer edition on  Saturday 24 June 2023. 

There are two session lengths for submissions. These are: 

  • 45 mins
  • 10 mins

The Call for Speakers is open and awaiting your submissions on Azure Synapse related content. If you are unsure what to submit check out our YouTube channel full of past event sessions. We would love to see your sessions, new speakers or experienced speakers, so submit now.

CfS: https://sessionize.com/data-toboggan-cool-runnings-2023/

You Tube: https://www.youtube.com/c/DataToboggan

Web: https://www.datatoboggan.co.uk/

Sunday 2 April 2023

In a Nutshell Concept Map

There is lots of talk about DAMA-DMBOK2 and DCAM and this can be confusing for people who are new to data governance and data management. There are many definitions describing what data governance is. For example Wikipedia states

'Data governance is a term used on both a macro and a micro level. The former is a political concept and forms part of international relations and Internet governance; the latter is a data management concept and forms part of corporate data governance.'

I came across this article  Data Management and Data Governance in a Nutshell which has a useful concept map of data management and data governance definitions. DAMA and  DCAM are fairly well aligned now.