Welcome

Passionately curious about Data, Databases and Systems Complexity. Data is ubiquitous, the database universe is dichotomous (structured and unstructured), expanding and complex. Find my Database Research at SQLToolkit.co.uk . Microsoft Data Platform MVP

"The important thing is not to stop questioning. Curiosity has its own reason for existing" Einstein



Wednesday, 12 September 2018

Azure Data Factory Data Flows


There is a preview for a new feature called 'Data Flows' that enables visual data transformation capability within Azure Data Factory (ADF). This is scaled out using Databricks. This is available in the ADF Resource Explorer. Data Flow should enable a deeper understanding of your data. Monitoring and inspecting pipelines can be done in ADF. The transformations occur inside Azure Databricks which uses the Spark engine to distribute data across partitions. 




References

Microsoft Azure Data Factory documentation for Data Flow during preview is available here: https://aka.ms/adfdataflowdocs

Azure Data Factory: Visual Data Flows for Data Transformation (Preview)

Posted by at
Labels: , ,

No comments:

Post a Comment

Note: only a member of this blog may post a comment.

Subscribe to: Post Comments (Atom)