A Data Governance Story Part 2

 The second part of the governance story.

Data Catalogues are the foundation stones of data governance  

Data landscape knowledge is a wonderful thing. The data map enables the organisation of data sources by business flow within a security boundary 

Data passed through many different areas being transformed by the rich data he found along the way 

Being able to find and discover new data with ease, is important to bring a data culture to an organisation 

Data provenance can be such an insightful thing 

Automated data classification in tools such as #MicrosoftPurview help speed up insight into data

Managing data sharing between organisations 

A consistent planned route on a map with accurate place location, validated using a compass. The uniqueness of natural geology in a national park complete with a photo & passed the finish line on time 

Data policies for access, security, data residency governing the use of data amongst groups and locations 

Readiness assessments are a great place to start 

Help a business obtain a standard set of commonly used terms across the teams

Data Ethics is a key component of governing data 

Meta data come in many forms  

Establishing a data governance operating model for a village requires all the interconnected parts to come together as a whole for the best outcome 

Data Strategy sets the path to success 

Azure Synapse MVP series video

In the Azure Synapse Analytics month's MVP series video, Ryan Majidimehr was joined by two MVPs, myself and Andy Cutler, to talk about the upcoming Azure Synapse conference called Data Toboggan.  https://msft.it/6019eRKad

A Data Governance Story

 A tale for December. The business and the frameworks.

Time for some cheer 

Datum and Data on a journey. The Data Owner life 

Data working with other stewards

Business is thriving with well governed data 

Data Management Body of Knowledge (DAMA-DMBOK2)  shares the principals of effective data management

The Cloud Data Management Capabilities Framework (CDMC) provides an industry best practice for data management and analytics  

CMMI’s Data Management Maturity (DMM) Model covers best practices for providing support for the implementation of process in 5 categories  

The Data Management Capability Assessment Model (DCAM) can be used for new data management programs or to benchmark  existing programs progress 

The Control of Data Expediently (CODEX) framework allows a birds eye view of the entire system to be taken, to help combine all the elements and environment 

Data having fun juggling and working with different frameworks to cover all elements

Catch the next instalment later.

Alpine Coaster 2022 Schedule

 Our final event of the year. The Alpine Coaster event schedule. To find out more go to the website.

Day 2 PASS Data Community Keynote

The keynote is about Doing More with Less: The Challenges Ahead for Every Data Professional. These are challenging times for every business everywhere. So how can you ensure you get the most from your investment in IT, to meet your needs now, while also preparing you for an uncertain future? Join Jakub Lamik, Steve Jones and Kathi Kellenberger in this keynote which looks at how the world is changing for data professionals, and the areas to focus on which will bring the best return on your investment in the long term.

Speakers

Steve Jones | Advocate

Jakub Lamik | CEO

Kathi Kellenberger | Customer Success Engineer

David Bick | Head of Product Marketing

Arneh Eskandari | Solutions Engineering Manager

There were123 sessions yesterday. Make sure you take advantage of the  networking opportunities.

16.10 Steve Jones opens the keynote talking about Kalen the technical people he had met. Opportunity, to learn and be inspired. 

Redgate are expanding across multi databases with there tools. Redgate live the Devops way, build a great culture internally and community centred. SQL Saturday started to bring it to the community. Redgate gave it to PASS. Then donated PASS away after buying it last year. 

The CEO of Redgate is on the stage.  More than a conference: a homecoming. Why important to invest in the community? Database professionals answer important questions about our world.

Every business is a software business - Satya Nadella

Software means data really, how data is ubiquitous and how it enables transformation.  Change is constant.

How has the database landscape changed.

Open source is increasingly important, all sectors and all segments. A powerful tool for community.

Cross database estate is on the rise.  - From the state of the data estate report.

Fragmentation is accelerating. Developing are influencing the databases they use.

PostgreSQL and MySQL are developing the most. SQL Server in the top 6.

Multi database environments are here to stay and complexity is growing - Steve Jones

Micro Services enable agility between software and dev teams - further drives fragmentation

Complexity is mirrored in the environment and automation required with a standard set of tool and approach. This helps with the Devops environment.

David Bick is on the Stage

Just solving SQL Server problems is just not enough for our customers. A lot of postgreSQL  growing. 

Flyway is a database schema for a standard approach using more than 25 databases. From on prem to cloud. Redgate bought and support the open support project.

Gives richer automation. Design principles - should be able to work the way you want to, flexibility, Tools and approach need to be the same but the changes need to be database specific. 

Flyway Enterprise is released for SQL Server and Oracle. This will unlock devops for developers.

Migration to cloud is expanding and Redgate can deploy in hours. Cloud required collaboration. No more silos. DBAs must be database agnostic and support hybrid database estates. 

Arneh  is on the Stage. Security and monitoring is centralised, but individual business units chose different platforms. 

Scalability and being held back . Domain expertise is needed from various cloud technologies. Not enough dashboards across all of these.  Cost control is required to be kept as low as possible. 

A typical financial set up 1000+ database 50/50 split on prem and in the cloud in the UK and US. They need granular monitoring as there is no holistic monitor. 

About solutions, community and support. 

How to help you grow. There are lots of new speakers at Summit this year.  How many children want to be a DBA when they grow up. Simple talk is a great launching point for your career. Louis Davidson is the new editor of simple talk. 

Adoption, results and advocacy in customer success. They are the face of the customer internally and getting value out of there products. Customer success is who Redgate are. Also further ongoing professional development.  There are free industry learning classes which were created in the pandemic.

The debut Redgate 100 most influential in the database community 2022 was shared.

Day 1 Keynote PASS Data Community Summit

The day 1 keynote of the first in person PASS Data Community Summit was packed with exciting data platform innovations across SQL Server and the Microsoft Intelligent Data Platform.

The Keynote: Transform your Data Estate with Microsoft's Intelligent Data Platform.

There are many data challenges today within operational database, analytics and intelligence and data governance. 

 

Data officers are a critical role and it is a challenge to use the data right. A lot of governance tools are not fully integrated. 

Analytics is a core part and must be front and centre not a back end tool. Data Governance is more than creating a catalogue, it is hybrid and multi cloud and the volume of data is increasing. Data Governance needs to be deeply embedded.

The big announcement : SQL Server 2022 is generally available

SQL Server 2022 with embedded data governance. All the data management through Microsoft Purview, lineage tracking is very important. 

There is a new SQL Server pay-as-you-go licensing model 

The annoucements

SQL Server 2022 - GA (Generally Available)

New SQL Server pay-as-you-go licensing model

Link feature for Azure SQL Managed Instance

Backup portability with SQL Server 2022

SQL + Apps Migration Factory offer

Azure Cosmos DB for PostgreSQL - GA

Azure Data Factory SAP Change Data Capture Connector -GA

Azure Synapse Mapping Data Flow for M365 Graph -Public Preview

Azure Synapse Link for SQL

The keynote  then switched to data governance

Improved root cause analysis and traceability with SQL Dynamic lineage is GA

PASS in Seattle

My visit to PASS Data Community summit in Seattle involved my first flight out of the UK since Covid, 3 speaking opportunities and a visit to the Microsoft Reactor in Redmond to speak with the product teams. It is nice to be out travelling to conferences again and networking with the data community. There is so much added value to be had.