Welcome

Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein



Sunday, 29 January 2023

Data Toboggan Winter Edition 2023 event summary


Data Toboggan winter edition ran on Saturday 28 January 2023. This was our third year and fifth conference. We started with one track of 12 hours and this is the second conference we have had with two tracks of sessions.  So many amazing speakers and sessions of interest. 

Our speakers were from 14 countries this time
USA 10 speakers; Poland 2 speakers; Finland 1 speaker; UK 2 speakers; Germany 2 speakers; Peru 1 speaker; Denmark 2 speakers; India 1 speaker; Sweden 1 speaker; Netherlands 1 speaker; Canada 1 speaker; Brazil 1 speaker ; Uruguay 1 speaker; New Zealand 1 speaker and Australia 1 speaker.

I was pleased to see there were a lot of questions and chat in the rooms and lots of links shared for future reading material.  To help people read up on the links shared, I list them here:

Azure Room

Data Toboggan - YouTube – Watch, subscribe and like.

Data Toboggan Website for news of what is coming next

Data Toboggan | Conference Meetup group for conference registration

Data Toboggan Slide Preparation | User Group

We are putting together categories of the sessions to help people learn Azure Synapse Analytics Learning - Data Toboggan

We were asked several time do we share the videos on the YouTube channel.? We seek approval of the speakers to publish their sessions, and usually aim to publish them around 6 weeks after the event. We can not guarantee all sessions will be available to watch online.

Other learning https://events.sqlbits.com/2023/training-days

The detective agency https://detective.kusto.io/

Recommendation:  T-SQL Fundamantals by Itzik Ben-Gan as an awesome reference

Doing Power BI The Right Way

https://sqlserverbi.blog/presentations/

Analytics Room

Azure Synapse Analytics Migration Guides - Azure Synapse Analytics | Microsoft Learn

Azure Synapse Compatibility Checks - Microsoft Community Hub

Known limitations and issues with Azure Synapse Link for SQL - Azure Synapse Analytics | Microsoft Learn

Dimensional Modeling Techniques - Kimball Group

It is a Data modelling warehouse toolkit, complete star schema reference guide, agile data warehouse design

BEAM Templates — modelstorming.com https://modelstorming.com/templates

Brian Bønk Rueløkke: Slides and code for the Synapse CETAS, Views, Parquet can be found here:

public/Speaks/2023/2023-01-28 Data Toboggan at master · brianbonk/public (github.com)

 Azure Synapse Link for Azure Cosmos DB, benefits, and when to use it | Microsoft Learn

MicrosoftLearning/DP-203-Data-Engineer (github.com)

Azure Synapse Analytics August Update 2022 (microsoft.com)

https://spark.apache.org/docs/3.0.0-preview/sql-ref-syntax-ddl-repair-table.html

Convert databricks noteboooks.dbc into standard .py files - Stack Overflow

Synapse Room

The whitepaper  is good documentation

Azure Synapse Analytics security white paper: Network security

A favourite podcast of ours

Knee-deep in Tech Podcast (kneedeepintech.com)

Certification links:

https://learn.microsoft.com/en-us/certifications/azure-data-fundamentals/

Microsoft Certified: Azure Data Engineer Associate - https://learn.microsoft.com/en-us/certifications/azure-data-engineer/?WT.mc_id=DP-MVP-5004032

Microsoft Certified: Azure Enterprise Data Analyst Associate - https://learn.microsoft.com/en-us/certifications/azure-enterprise-data-analyst-associate/?WT.mc_id=DP-MVP-5004032

Coming soon: The new Azure Enterprise Data Analyst Associate certification

Microsoft ESI -https://esi.microsoft.com/ 

Databricks Academy - https://www.databricks.com/learn/training/login

The exams change regularly, so for any exam it's best to review the study guide. For example here's the DP-203 one;

https://query.prod.cms.rt.microsoft.com/cms/api/am/binary/RE4MbYT

Blog: https://www.KevinRChant.com
GitHub: https://github.com/kevchant

PastPresentations GitHub repository , which you can find at https://github.com/kevchant/PastPresentations

https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/develop-openrowset for difference in parser versions


Comparison table is here: https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/understand-synapse-dedicated-sql-pool-formerly-sql-dw-and/ba-p/3594628

PVLDB Proceedings Template - WORD -> polaris whitepaper

How to use CETAS on serverless SQL pool to improve performance and automatically recreate it - Microsoft Community Hub

Synapse Spark Delta Time Travel - Microsoft Community Hub

Understand Synapse dedicated SQL pool (formerly SQL DW) and Serverless SQL pool - Microsoft Community Hub

An interesting question to think about: which term will dominate in next 5 years? will it be a data lakehouse? or data mesh? 

Monitoring Synapse serverless SQL pool query history

Monitoring serverless SQL ended requests by using Log Analytics    

I  would like to thank all the speakers for their time and amazing content. So grateful to fellow organisers Andy Cutler and Richard Munn and our moderators,  Justin Bird and Shabnam Watson. And thank you to our attendees for making the day, such a fun day. We are already ready exciting about the next one in the summer.

No comments:

Post a Comment

Note: only a member of this blog may post a comment.