Tag Archives: Datalake

Domains And Access For Metadata

What actually is used to describe the provenance and information that comes with our data? Today we discuss metadata and the governance, security, hint, domains, date that accompany data in ways that in some senses are more important than data.

How can we move, change and transform data? We had a really robust conversation about how access to data is so critical in actually understanding how data is used.

This is a topic we struggle with: figuring out the naming, how things work, and the context. More than anything else, the context makes things challenging. As you listen to this, think through how challenging it is to define data, data governance, and using data effectively.

Transcript: otter.ai/u/VE2u_jTwG_h4z9ewfI…?utm_source=copy_url
Image: www.pexels.com/photo/cheerful-bl…hoolkids-5905918/

Metadata For A Data Control Plane

https://soundcloud.com/user-410091210/metadata-for-a-data-control-plane

Metadata is information that travels with the raw data that provides context, provenance, security, authorship, controls, and indexing.

The number of ways that you can expand the use of data is controlled by adding metadata. It creates a change in how we look at and manage data. Instead of creating control systems that contain the data, it’s actually packaged the control infrastructure, or the data control plane, as part of the data so that all of the systems can participate in it.

We also talk about data mesh a lot in that context.

Transcript: otter.ai/u/bho2SHu0N1YfECix6X8qNvKTlB4
Image: www.pexels.com/photo/pensive-eth…up-phone-3760607/

Rob’s Hot Take:

In the Cloud 2030 Podcast episode from January 19th, Rob Hirschfeld discusses the challenges and opportunities associated with metadata, particularly in the context of managing and sharing data effectively. The conversation explores the concept of packaging raw data in a way that makes it available on request without being included, accompanied by metadata detailing its provenance, access permissions, context, and even expiration dates. Hirschfeld emphasizes the importance of building a data control plane to navigate the complexities of data consumption and production, envisioning a future where metadata plays a crucial role in weaving together diverse data sources. Listeners are encouraged to explore the full 40-minute discussion for comprehensive insights, and to join ongoing conversations at the2030.cloud.