Welcome

Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein



Friday, 24 June 2022

Cool Runnings 2022 Piste Maps

The wait is over the Cool Runnings 2022 Piste Maps are available. Not one but 2 piste maps, one for the Synapse room and one for the Analytics room . We have more then one slope that enables predictive analytics as we are running 2 tracks.

Register: https://bit.ly/DT-CR22Register Agenda: https://bit.ly/DTCR2022Agenda #azuresynapse @Azure_Synapse




Thursday, 23 June 2022

An interactive word cloud full of sessions

For our Data Toboggan Cool Runnings 9 July event we continue to evolve our analytics.

Did you interactively want to see what is included in the sessions. Check out the bottom of agenda page.

Agenda: https://bit.ly/DTCR2022Agenda



Don't forget to Register at the same time: https://bit.ly/DT-CR22Register


Monday, 20 June 2022

Session Content for Data Toboggan Cool Runnings 2022

There is some amazing content to be shared in our next conference so why not spend the day learning  with 2 tracks of content to choose from. 









Register: https://bit.ly/DT-CR22Register

Agenda: https://bit.ly/DTCR2022Agenda 





Saturday, 18 June 2022

Microsoft Purview Data Estate Insights

Microsoft Purview Data Estate Insights will be generally available 1st July 2022. This is an important feature to help the Chief Data Officer (CDO) gain insight about the data estate. The data estate insights helps an organisations connect to diverse hybrid data sources. There will be a new dashboard for Data stewardship, where you can see key metrics about your data estate's health and performance.


The Data Estate Insights covers key insights:

Health – key metrics that pose governance risks or risks to their catalog’s adoption with a data stewardship report

Inventory and Ownership - detailed drilldowns of asset distribution by department and ability to remediate in-app, with the Assets report.

Curation and Governance – details of classified, labelled, or termed assets and where tags may be missing, indicating a potential governance gap, starting with Classification, Glossary and Label reports





 








Actionable insights with KPIs shows what percentage of the data estate does not have assigned data owners and  how many assets are fully, partially, and not “curated”. This can help indicate if there is a significant return on investment. A scorecard gives an idea of the criticality of risks on the data estate.















These metrics can be drilled into further in a tree map. There is also the availability of trend analysis of key governance metrics. You can export the data for offline tracking and follow ups.

Note: Insights generation is enabled at provisioning. 

Thursday, 16 June 2022

Tuesday, 14 June 2022

Thursday, 2 June 2022

Tech in Ten at SQLBits

Great to see SQLBits post this. 

We keep getting more and more from the team at @venturi_ltd  with their Tech in 10 Podcast - Recorded at SQLBits!🎧

from discussed and more #data-related subjects, as well as SQLBITS!🧡 Listen on any podcast platform🎙️ https://pod.co/tech-in-ten/ep-9-dr-victoria-holt-enterprise-data-architect-coeo



https://pod.co/tech-in-ten/ep-9-dr-victoria-holt-enterprise-data-architect-coeo

Wednesday, 1 June 2022

A summary of Microsoft Purview tools


The new Microsoft Purview is a comprehensive set of solutions to help govern, protect, and manage your entire data estate. This new brand family combines the capabilities of the former Azure Purview and the Microsoft 365 Compliance portfolio, providing unified data governance and risk management. The benefits are it
  • helps gain visibility into assets across the entire data estate.
  • enables easy access to all data, security, and risk solutions. 
  • helps safeguard and manage sensitive data across clouds, apps, and endpoints.
  • manages end-to-end data risks and regulatory compliance.
  • empowers organization to govern, protect, and manage data in new, comprehensive ways.
The full suite of combined products in the Microsoft Purview Suite announced recently here

There are 2 areas: 

Risk & Compliance – for risk, compliance and legal teams
Unified data governance – for data consumers, data engineers, data officers

The various tools are summarised below.

Microsoft Purview Audit

Helps respond to security events, forensic investigations, internal investigations, and compliance obligations. Microsoft Purview provides two auditing solutions: Audit (Standard) and Audit (Premium).





A comparison of the key capabilities

Communication compliance helps with complying with internal policies and regulatory compliance requirements. It has focused policy templates and a flexible workflow, with actionable insights to quickly resolve detected compliance issues.

 

Microsoft Purview Compliance Manager

This is a feature in the Microsoft Purview compliance portal that helps with management of organizational compliance requirements. Compliance Manager covers the entire journey, from taking inventory of the data protection risks to managing the complexities of implementing controls, staying current with regulations and certifications, and reporting to auditors.



Microsoft Purview Customer Lockbox

Customer Lockbox brings you into the approval workflow process that Microsoft uses to ensure only authorized requests allow access to your content. The audit record is logged in the audit log when a person in your organization approves or denies a Customer Lockbox request.Microsoft Purview Data Catalog

Data Catalog is an enterprise-wide metadata catalogue that enables data asset discovery. It’s a fully-managed service that lets you register, enrich, discover, understand, and consume data sources.




Microsoft Purview Data Connectors

Supported data sources , file types, and scanning concept



Microsoft Purview Data Lifecycle Management

Manage information lifecycle and records intelligently through

  • Data retention and deletion: Manage risk and liability by keeping only what is needed across the entire digital estate.
  • Records management: Manage high-value records while meeting the legal and regulatory requirements.
  •  Automated policies: Classify and govern data at scale based on file properties, the presence of sensitive data, or machine learning.
  • Proof of compliance: Demonstrate compliance with label analytics insights, defensible disposal, and rich audit trails.


Microsoft Purview Records Management

To manage legal obligations to demonstrate compliance with regulations, increase efficiency with regular disposition of items that are no longer required to be retained, no longer of value, or no longer required for business purposes. The capabilities for Microsoft 365 services and apps:

  • Label content as a record
  • Migrate and manage your retention requirements with file plan
  • Configure retention and deletion settings with retention labels
  • Start different retention periods when an event occurs 
  •  Review and validate disposition
  • Export information about all disposed items
  • Set specific permissions

Microsoft Purview Data Map

The Microsoft Purview data map provides the foundation for data discovery and data governance. It captures metadata about data present in analytics, software-as-a-service (SaaS), and operation systems in hybrid, on-premises, and multi-cloud environments. The Microsoft Purview data map stays up to date with its built-in scanning and classification system.

Microsoft Purview Double Key Encryption

Double Key Encryption (DKE) uses two keys together to access protected content. Microsoft stores one key in Microsoft Azure, and you store the other key.  

Microsoft Purview eDiscovery (Standard and Premium)

Electronic discovery, or eDiscovery, is the process of identifying and delivering electronic information that can be used as evidence in legal cases. Microsoft Purview provides three eDiscovery solutions: Content search, eDiscovery (Standard), and eDiscovery (Premium).







Microsoft Purview Information Barriers

A compliance solution that allows two-way communication to be restricted and collaboration between groups and users in Microsoft Teams, SharePoint Online, and OneDrive for Business.

Microsoft Purview Information Protection

To enable discovery, classification, and protect sensitive information wherever it lives or travels.These information protection capabilities tools are to know your dataprotect your data, and prevent data loss.



Microsoft Purview Data Loss Prevention

Identify and help prevent risky or inappropriate sharing, transfer, or use of sensitive data on endpoints, apps, and services. Microsoft Purview Insider Risk Management

A compliance solution that enables detection, investigation, and act on malicious and inadvertent activities in your organization. Insider risk policies allow the types of risks to be defined to identify and detect, including acting on cases and escalating cases to Microsoft eDiscovery (Premium) if needed. 



Microsoft Purview governance portal

Microsoft Purview is a unified data governance service that enables a foundational understanding of on-premises, multi-cloud, operational and SaaS data.

Microsoft Purview compliance portal

The Microsoft Purview compliance portal provides easy access to the data and tools you need to manage to your organization's compliance needs.


In Microsoft Purview Data Estate Insights, you can get an overview of the assets that have been scanned into the Data Map and view key gaps that can be closed by governance stakeholders, for better governance of the data estate.

Microsoft Purview Customer Key  Customer Key only encrypts data at rest in the cloud. It provides extra protection against viewing of data by unauthorized systems or personnel, and complements. It helps meet regulatory or compliance obligations for controlling root keys. 






Microsoft Priva is a new category of features in Microsoft Compliance Centre, providing solutions for data privacy compliance

Priva Subject Rights Requests

Subject Rights Requests, sometimes called data subject access requests (DSARs), or consumer rights requests,  enquires are sorted with workflow, automation, and collaboration capabilities for helping data search for subject data, reviewing findings, appropriate file collection, and reports. 

Priva Privacy Risk Management

Privacy Risk Management enables the set up of policies that identify privacy risks in the Microsoft 365 environment and enable easy remediation. Privacy Risk Management policies are meant to be internal guides to 

  • Detect overexposed personal data so that users can secure it.
  • Spot and limit transfers of personal data across departments or regional borders
  • Help users identify and reduce the amount of unused personal data that you store.


Workflows - preview feature

Workflows are automated, repeatable business processes that users can create within Microsoft Purview to validate and orchestrate CUD (create, update, delete) operations on their data entities. Enabling these processes allow organizations to track changes, enforce policy compliance, and ensure quality data across their data landscape.

Policies - preview feature

Access policies in Microsoft Purview enable management access to different data systems across the entire data estate. Data access policies can be enforced through Purview on data systems that have been registered for policy.