Orchestration Automation Workflow [with Terraform]

Building reliable automation at scale for infrastructure presents challenges. In this episode, we discuss orchestration, workflow automation, and the reconciler pattern in the context of Terraform.

We refer to the pattern of Terraform, automation, and orchestration systems as “TACOS” and today we dig into how you test it and check it against drift. These are real topics of operational concern for anybody building any type of infrastructure.

Transcript: otter.ai/u/w-NA0HBsTc5NRaqWQQwlWUj4Whw
Image: www.pexels.com/photo/person-hold…ith-food-8448079/

Rob’s Hot Take:

In the April 5th Cloud 2030 Podcast episode, Rob Hirschfeld discusses orchestration, automation, and workflow, focusing on Terraform and introducing the “Terraform Automation and Orchestration” (TACO) pattern. The conversation emphasizes that while Terraform is a valuable tool, the broader patterns of reconciliation, GitOps, and event-driven automation are crucial for building and maintaining complex systems over time. Hirschfeld encourages listeners to view tools like Terraform and Ansible as initial steps in a journey, prompting consideration of scaling, building orchestration systems, and understanding the importance of comprehensive system development. For more in-depth discussions, explore the full episode on orchestration, automation, and workflow from April 5th, and join the ongoing conversations at the2030.cloud.

Does Your Metaverse Take MasterCard or Visa

How are Metaverse environments built? Today we talk about how we use intellectual property to build these Metaverse environments, and who has access to what and who’s going to create it. That turns into a discussion on how you’re going to pay for it.

Typically, Metaverse is framed as a platform, but we got interested in the content, media wars, and streaming platforms. Since we started the conversation at streaming media, that led us to payment platforms and transactions. It was fascinating that we couldn’t talk about intellectual property without also talking about payment and purchase transactions.

Transcript: otter.ai/u/Be5ZKdeQvvubwQhCFzhFAHTdtak
Image: www.pexels.com/photo/girl-wearin…lden-hour-166055/

Rob’s Hot Take:

In the April 7th Cloud 2030 Podcast episode, Rob Hirschfeld explores the complex dynamics of intellectual property in the metaverse. The discussion delves beyond the ownership of intellectual property itself, emphasizing the crucial role of payment platforms and how transactions for content will be facilitated. Hirschfeld highlights the intersection of payment platforms, cryptocurrencies, and microtransactions, underscoring the potential influence of jurisdiction within the Metaverse on the acquisition, usage, and transactions related to intellectual property. For an in-depth exploration of these topics, tune in to the full episode on April 7th, available on the2030.cloud.

Uses for Distributed Ledger Technology

Today’s discussion was about distributed ledger technology (DLT), also known as blockchain and the technology behind Bitcoin. We had a balanced discussion: some people who were excited about the technology and others who were skeptical. That interplay really created one of the best conversations I’ve heard about DLT and its applications

Throughout the conversation, we tested each other and we came back to basics. We didn’t assume that blockchain was good because it was new, or that organizations like Banks or Ticket Sellers were bad. That neutrality really plays out by helping us consider how DLT can actually benefit people.

Transcript: otter.ai/u/iox4ywvekE-3zWDDWyAPFkUGJtA
Photo: www.pexels.com/photo/toasted-bre…ch-fries-1437568/

Everything As Code !

What makes Everything as Code and Infrastructure as Code interesting? In today’s episode, we discuss what makes something code-like and the idea of Everything as Code, based on Patrick Dubois’ article “In depth research and trends analyzed from 50+ different concepts as code.”

Reference: www.jedi.be/blog/2022/02/23/tre…0-as-code-concepts/

Some of our conclusions were practical, like if a concept is a process that is reproducible and auditable, that’s what makes it code-like. And some other possible conclusions were that it’s just marketing because it makes everything programmable. The reality is somewhere in the middle.

Transcript: otter.ai/u/E1TezO2XutwJyS-vCNetslwWO4A
Image: www.pexels.com/photo/man-in-grey…icky-note-879109/

Rob’s Hot Take:

In the Cloud 2030 Podcast episode on March 29th, Rob Hirschfeld provides insights on the “everything as code” discussion. While acknowledging the term’s playful exaggeration, Hirschfeld emphasizes the underlying desire for reproducibility, auditability, and code-like experiences in various aspects of operational and infrastructure activities. Despite the term’s potential for marketing hype, the aspiration to apply code principles to different facets of infrastructure management remains significant, influencing how we build and manage systems. To delve into this engaging discussion, check out the full episode on March 29th, available on the2030.cloud.

How Lock in Creates Risk

Organizations take a risk when they get locked into a vendor. In today’s episode, we talk a lot about the risks of lock in, both in general and in the context of Oracle.

That discussion takes us into a question of insurance, and if insurance policies could ultimately drive people to reduce lock in exposure. This was a fascinating discussion, not only about lock in but about what would drive organizations to fix their lock in problems.

Transcript: otter.ai/u/zJf0WMUwJgamk7IpscHCsL2vsV4
Image: www.pexels.com/photo/closed-white-door-3119977/

Rob’s Hot Take:

In the Cloud 2030 Podcast episode on March 31st, Rob Hirschfeld discusses the intricate aspects of vendor lock-in, focusing on the risks associated with relying on a single provider, such as an authentication service like Okta. The conversation delves into the challenges of migrating away from tightly integrated platforms and emphasizes the importance of assessing and mitigating lock-in risks. The broader theme within Cloud 2030 discussions seems to revolve around identifying and understanding various risk factors in building complex infrastructures, aiming to drive market dynamics by addressing and managing these risks. To explore this insightful discussion further, check out the full episode on March 31st at the2030.cloud and become part of these engaging conversations.

Goldilocks Platforms [w James Urquhart]

A Goldilocks’ balance challenges us to trade off prescriptive and flexible platforms. James Urquhart shares his experiences with Cloud Foundry, VMware, and Amazon about trying to find the right balance between building it yourself versus a prescriptive service approach.

We’ve decided that there needs to be a middle zone with enough opportunity for customization, as well as enough pre-set, prescriptive methods to create sustainability.

In this episode, we talk about that balance and how different processes have done it in industry.

Transcript: otter.ai/u/OQBfCHldtYjUpqjKdkN3KjzLiR0
Image: www.pexels.com/photo/brown-teddy…h-outside-207891/

Rob’s Hot Take:

In the Cloud 2030 Podcast Lunch and Learn on March 22nd, Rob Hirschfeld explores the Goldilocks problem, focusing on the challenge of striking the right balance between prescriptive platforms and open toolboxes. He emphasizes the difficulty of handling the diverse and heterogeneous nature of various systems while aiming for reuse, reduction of toil, and collaboration. Hirschfeld points out the nuanced nature of variations within the 80-20 rule, stressing the importance of considering how toolboxy or prescriptive a platform should be based on individual needs. To delve deeper into this thought-provoking discussion with insights from James Urquhart, check out the full episode on March 22nd at the2030.cloud and become part of these engaging conversations.

Complexity vs Value [& Okta hack]

The Okta hack highlights the value versus complexity trade off. In today’s episode, we ask if the complexity of using single sign on is the right move in this context. We also think about how to deal with these interconnected systems that have high degrees of complexity.

We also discussed API design, and whether or not we should have more rigid or flexible APIs. You can’t remove complexity from the system, but you can hide it. The structure of APIs will push complexity into either the users’ realm or the operators’ realm.

Transcript: otter.ai/u/cftY6wlMTzAceT2EiHF4u4u0dpE
Image: www.pexels.com/photo/photo-of-an…ng-money-7884134/

Rob’s Hot Take:

In the Cloud 2030 Podcast on March 24th, Rob Hirschfeld delves into the complex relationship between complexity, value, and immutability in system design, particularly focusing on API interfaces. He emphasizes the trade-offs involved in exposing options to users, providing flexibility but potentially increasing complexity. The discussion highlights the practicality of using immutability and templates to control API complexity, acknowledging the challenges of finding the right balance and the importance of transparency in decision-making. To explore these insights further, listen to the full episode on March 24th at the2030.cloud and participate in these open conversations.

Improving Automation Safety

Making automation safe is essential to making it usable at scale. How do we make automation safe? We found a lot of great insights drawing from space craft design, aircraft, aircraft design and other systems where safety is super important.

Automation is a force multiplier. If we don’t factor in safety when we build it,then we could create a lot of harm in systems from wasteful spending to actual injury. These designs have very real implications.

Transcript: otter.ai/u/p9w4aKOqm3rpHhbDtRTaLgN3GIA
Image: www.pexels.com/photo/toddler-usi…-on-road-1642055/

Rob’s Hot Take:

In the Cloud 2030 Podcast on March 15th, Rob Hirschfeld underscores the critical importance of automation safety in system design. Emphasizing the need for thorough testing, he discusses how safety, especially in complex systems like airplanes and spacecraft, requires continuous testing and monitoring. The conversation delves into the significance of not just completing tasks but also exercising and testing systems in various scenarios to ensure their safety. To explore these insights further, listen to the full episode on March 15th at the2030.cloud and participate in the ongoing discussions.

Data Center Users: Majors vs Miners

Majors versus minors are enterprise data centers versus blockchain, bitcoin and distributed ledger data centers. We dive into the differences in processing and environmental requirements for those two different use cases.

While the idea of blockchain and distributed ledgers generate very different computational profiles, what we’re building keeps coming back to the design of a data center is design of a data center. The exception is proof of work like Bitcoin. In those cases, it’s really just how many CPUs you can run.

For this episode, we focus on proof of stake data center infrastructure. This podcast is helpful to understand the difference between proof of work and proof of state. There’s clear consensus on the call that that proof of work is not environmentally sustainable. So proof of stake is much more interesting.

Transcript: otter.ai/u/uuPJSF_nWeDLF64lZlsGLOY8JWw
Image: www.pexels.com/photo/man-holding-shovel-3285094/

Rob’s Hot Take:

In the Cloud 2030 Podcast, Rob Hirschfeld explores the distinctions between majors and minors in data center design, specifically comparing traditional enterprise workloads with proof of stake (PoS) and proof of work (PoW) data centers used for distributed ledgers and blockchains. The discussion reveals that the transition to PoS aligns more closely with enterprise data center needs, emphasizing reliability, performance, and security. Contrarily, PoW environments prioritize cost efficiency but face environmental challenges. This assessment suggests that PoS is likely to drive a resurgence in traditional data center designs. For a more in-depth exploration, join the ongoing conversations at the2030.cloud.

Expanding GitOps Beyond K8s

GitOps is a really important way of collaborating and communicating about infrastructure.

But can GitOps escape from Kubernetes? While we did talk about Kubernetes too, we mainly talked about what it takes to implement GitOps outside of Kubernetes. We considered building a GitOps architecture and then having people understand and use it. We also cover the fundamental parts of GitOps like having a reconciler and a bunch of tools that drive clusters.

Transcript: otter.ai/u/oq4D06Sd_rtUvXBVXC0Wx3KA2sQ
Image: www.pexels.com/photo/people-with…popcorns-7234318/

Rob’s Hot Take:

In the March 8th DevOps Lunch and Learn session on GitOps, Rob Hirschfeld emphasizes the crucial role of immutability in operations. The concept of specifying a fixed state, configuration set, or resource transforms how automation, infrastructure building, and system maintenance are approached. The investment in immutable components enhances change resilience, making it easier to adapt and keep up with changes while ensuring stability. Join the ongoing conversations and roundtables at the2030.cloud to contribute to discussions on these transformative concepts.