Tag Archives: Metadata

Domains And Access For Metadata

What actually is used to describe the provenance and information that comes with our data? Today we discuss metadata and the governance, security, hint, domains, date that accompany data in ways that in some senses are more important than data.

How can we move, change and transform data? We had a really robust conversation about how access to data is so critical in actually understanding how data is used.

This is a topic we struggle with: figuring out the naming, how things work, and the context. More than anything else, the context makes things challenging. As you listen to this, think through how challenging it is to define data, data governance, and using data effectively.

Transcript: otter.ai/u/VE2u_jTwG_h4z9ewfI…?utm_source=copy_url
Image: www.pexels.com/photo/cheerful-bl…hoolkids-5905918/

Metadata Architecture

Every time we look at data analytics and data systems, the idea of having a way to manage control and explain the data is actually as important as the data itself. This episode is all about metadata, specifically, metadata related to data analytics analysis, Big Data computation, sort of the data lake metadata problem.

Today we discuss the challenges of data management, but also the potential of understanding so much more about how data is used. If you are an IT professional or a data professional, you will find this conversation about how we’re going to draw inferences, manage and control all of that data that were collected fascinating.

Transcript: otter.ai/u/dFF6CfBYOMR3QFydae…?utm_source=copy_url
Image: www.pexels.com/photo/woman-stand…-mirrors-6208385/

Meta Data, Dark Data and Intent

https://soundcloud.com/user-410091210/meta-data-dark-data-and-intent

Data comes from many different places, sources, and ways. Some data we call dark data, which is data not accessible to you, and all of it relevant. Today we talk about metadata as part of the governance control management exposure of data.

An important layer beyond the data itself is the governance intent, how people access it, and how you combine data. We discuss exactly what that is, but still only touch the surface.

References:
yago-knowledge.org
en.wikipedia.org/wiki/Ontology

Transcript: otter.ai/u/rP_4gi-iDont0r2CaZ…?utm_source=copy_url
Image: www.pexels.com/photo/apples-and-…n-books-14098062/

Rob’s Hot Take:

In the Cloud 2030 Podcast episode on metadata and building a data control plane, Rob Hirschfeld emphasizes the challenge of controlling data egress due to its diverse sources and destinations. He contends that rather than attempting to create a locked box for all data, the focus should be on embedding information, particularly metadata, to control data consumption. Hirschfeld envisions a distributed system for a data control plane, involving multiple parties managing and providing consistent rules for data use, acknowledging the complexity of data storage across various locations. He encourages listeners to explore the insightful February 2nd episode and engage in ongoing conversations at the2030.cloud.

Metadata For A Data Control Plane

https://soundcloud.com/user-410091210/metadata-for-a-data-control-plane

Metadata is information that travels with the raw data that provides context, provenance, security, authorship, controls, and indexing.

The number of ways that you can expand the use of data is controlled by adding metadata. It creates a change in how we look at and manage data. Instead of creating control systems that contain the data, it’s actually packaged the control infrastructure, or the data control plane, as part of the data so that all of the systems can participate in it.

We also talk about data mesh a lot in that context.

Transcript: otter.ai/u/bho2SHu0N1YfECix6X8qNvKTlB4
Image: www.pexels.com/photo/pensive-eth…up-phone-3760607/

Rob’s Hot Take:

In the Cloud 2030 Podcast episode from January 19th, Rob Hirschfeld discusses the challenges and opportunities associated with metadata, particularly in the context of managing and sharing data effectively. The conversation explores the concept of packaging raw data in a way that makes it available on request without being included, accompanied by metadata detailing its provenance, access permissions, context, and even expiration dates. Hirschfeld emphasizes the importance of building a data control plane to navigate the complexities of data consumption and production, envisioning a future where metadata plays a crucial role in weaving together diverse data sources. Listeners are encouraged to explore the full 40-minute discussion for comprehensive insights, and to join ongoing conversations at the2030.cloud.