Data Ops Platforms [Does DevOps work in AI?]

We dive into data operations in today’s episode! We cover the idea that with all of the work we’re doing in AI and ML data analytics analysis, you actually have to steward your data.

We also cover processes controls, like what we have with DevOps in infrastructure, but with similar types of concepts (governance controls automation) around how your data is flowing in your system.

Transcript: otter.ai/u/pesotDnHCCD5lyPVx7…?utm_source=copy_url
Image by DALL-E

Compliance is Fun! (and why you care)

We dive deep into the technical subject of governance and policy enforcement, including the tools, techniques and processes that you need to be aware of to do a good job with policy and governance enforcement.

We cover how to get started, what to think about, what to be aware of, and chip away at your governance and policy challenges including developer development portals, infrastructure pipelines and DevSecOps.

Transcript: otter.ai/u/ND90jKHwbklUBOAwT1…?utm_source=copy_url
Image by Dall-E prompt “please make a carton that shows a regulator who is managing cloud and IT assets using impractical tools”

Rob’s Hot Take:

Rob Hirschfeld, CEO and co-founder of RackN and host of the Cloud 2030 Podcast, discusses the October 19th conversation about limiting large language models (LLMs) and AI. The discussion focused on creating legal limitations for artificial intelligence and technology, highlighting the potential impact of regulations such as Section 230, which governs internet service providers’ moderation of content. Hirschfeld suggests that changes to Section 230 could be a critical component in controlling emerging technologies, inviting listeners to explore the insightful conversation at the2030.cloud.

Compliance Comes to Kubernetes

What does it take to implement governance and compliance, because they are process controls much more than individual technologies. Today we discuss that a lot of the talks seem to be about governance and compliance, and we have a fascinating discussion about governance compliance and Kubernetes.

The idea that Kubernetes is maturing, losing the drama that is a hallmark of its first decade now and moving into a focus on managing how to control and have security, compliance and normality. Yet all of those things have a degree of tension with the vendors and users, which puts single choice compliance and governance
in direct conflict with open source competitive ecosystems.

This makes for a fascinating conversation where we touch on some really important issues for the industry.

Transcript: otter.ai/u/mAkvsYgMYMp_W8Bizk…?utm_source=copy_url
Image: Generated by Dall-E

Tofu vs a Death of Expertise

The TerraForm fork, now known as the OpenTofu project, is our first topic in today’s episode. We discuss what’s going on with that, the challenges, as well as the potential pressures from HashiCorp that created this whole situation.

How do we get experts to recover their authority and how do we look at organizations like that? We have about 20 minutes of really involved conversation about the book, Death of Expertise by Tom Nichols, from the previous podcast. If you haven’t heard our first part of the conversation, I suggest you go back and listen to our full Death of Expertise podcast.

We cover two topics, one of them short term and one of them long term. So it’s a nice, balanced industry discussion around what the fork means, what its impacts are and a little bit of recap. There’s some really spicy opinions around 32 minutes in if you want to jump forward, we resume our discussion about death of expertise.

Transcript: otter.ai/u/zGUYDP6DynzxPBNLM9…?utm_source=copy_url
Photo by lil artsy: www.pexels.com/photo/person-abou…ur-dices-1111597/

Data Darkages – do LLMs drive paywalls?

A coming Data Darkage is on its way, where we’re watching Reddit, Twitter and other companies take what used to be publicly available information and put it behind a paywall or gate.

Because of the way large language models are using this data and the value of the data, we are expecting to see that trend accelerate. This will have profound implications for how we think of, share, and use data in the coming years.

Transcript: otter.ai/u/e1XCyhSa9V81bgMpbo…?utm_source=copy_url
Photo by Pollianna Bonnett: www.pexels.com/photo/young-brune…e-chair-17687131/

Book Discussion: Investments Unlimited

This is the second installment of our book group, which is a discussion about Investments Unlimited. We have one of our authors, and a great all around DevOps enthusiast, John Willis, on the call with us.

As you might expect, while we talk about the book and John gives a lot of background and details about the book, we treat it with the classic cloud2030 style, and bring in AI, large language and advanced DevOps.

We take the topics of the book to the next level, and frame it in the moment of the year, looking beyond and into how the concepts of compliance, validation, team coordination and risk assessment are incorporated into the coming AI and how it changes in our landscape.

Sources
Book www.amazon.com/Investments-Unlim…tal/dp/1950508536
techstrong.ai/aiops/the-rise-of-shadow-ai/
guidehouse.com/insights/financia…-lines-of-defense

Transcript: otter.ai/u/uC9c3xJS4oATQx7BrY…?utm_source=copy_url

Are Platform Teams Good?

How do you build effective, productive platform teams? What should their mission be, and what type of tools and dangers do they have? 

We start by questioning if there are such things as platform teams and their roles, as well as how they can go awry in modern organizations. 

At the end, we recognize that they do and can provide a very important role. In this conversation, you will learn the right ways to form a platform.

Transcript: https://otter.ai/u/Kf-Hi9H6bTmhufavGaa1ae9w_R4

Image: https://www.pexels.com/photo/man-beside-woman-in-train-1970830/

Rob’s Hot Take:

In the August 23rd DevOps Lunch and Learn, Rob Hirschfeld discusses the evolving concept of platform teams as centers of excellence for corporate governance and controls in IT and operational environments. He notes the current diversity in approaches to solving problems in infrastructure but anticipates a consolidation phase where standardization becomes more prominent. Hirschfeld emphasizes the cyclical nature of IT innovation, suggesting that platform teams will play a crucial role in advocating for standards, processes, and best practices, ultimately contributing to the industry’s progress.

Humans vs Code: Governance As Code

Human factors make governance as code a challenge – today we discuss why looking at things like audit and how we determine what has happened and respond to it in an automated way, may be a great first step to adding controls into a system.

We talk about a lot of human factors of what makes it hard to create a governance system, or what creates a biased system or an unevenly governed system.

We spent the first couple minutes of this podcast talking about our agenda, and those conversations spell out a lot of interesting topics that we will discuss. So hang in for those first couple of minutes, and then we will get straight to the governance.

Transcript: otter.ai/u/aqx5-wivDgPARqAXwXGCIm-bO5U
Image: www.pexels.com/photo/belgium-fla…-building-532864/

Real Life Chaos Monkeys And Other Infrastructure Challenges

How do we use chaos monkeys in real life, and practically? This happens all the time when we have failures. The Rogers failure that took out the internet and cell phone use in Canada last week was the start of our discussion.

Predicting how things are going to go out is a common theme for chaos monkeys, and really comes back to how we test infrastructure. Should we be putting it under stress in planned ways like Chaos Monkey, in order to ensure that our increasingly internet and power dependent society is prepared for the inevitable outages?

We have a really fascinating discussion about what it would take to make this type of practice real, including alternatives that people can look at today.

Transcript: otter.ai/u/D0ZV5c3ikvAiinsK7ugf_duCjv8
Image: www.pexels.com/photo/monkey-sitt…s-hands-11999152/

Infrastructure Governance As Code

We continue our Governance as Code discussions in today’s episode.

We started by very broadly looking at Governance as Code generally, but quickly drilled down into Infrastructure as Code meets Governance as Code focused discussion. Understanding that intersection is critical to building something that is both automated and governable.

The topic explored how we audit controls for systems. We also need to make sure that when we build infrastructure, it’s following our policies. The challenge here is making sure that what we’ve automated is conforming to our governance.

Image: www.pexels.com/photo/group-of-pe…tructure-2100942/
Transcript: otter.ai/u/-vI03TkWcLpvTIBRrrKE9DugYvw