Building Infrastructure for AI Training & Inferencing
cloud2030
by the2030.cloud Podcast
1w ago
How do you define infrastructure to support inferencing? Today we discuss that and more, including training. We walk through what it's going to take to understand what to buy, what to build, how to build, how to put it together, and how hard it is to actually know what goes into the infrastructure behind an AI cluster. Importantly, exploring why we don't have the answers is the first phase of understanding. Transcript: https://otter.ai/u/2SIZyiLDtfyi_zGrol8qHvHc0gA?utm_source=copy_url ..read more
Visit website
Out Of Band Management [TechOps Series]
cloud2030
by the2030.cloud Podcast
1w ago
We continue our TechOps series, this case diving deep and cheap into out of band management. One of the things about out of band management is that it quickly turns into an alphabet soup of protocol names, vendor names, specific pieces and even the way we talk about out of band management. We have different acronyms for the same action. In this conversation. Greg Althouse reckons CTO and my co-founder explores lessons learned and things that you need to understand for technical details and a really core understanding of how to build BMC integrations. We even cover why it's so hard to do this w ..read more
Visit website
Understanding SystemD [TechOps]
cloud2030
by the2030.cloud Podcast
1M ago
System D is our topic for today discussing system processes, how do you manage and control processes, services, and fundamental components of Linux operating systems. In this discussion, we cover how to think about it, how it works, alternatives, process controls, and even how they get applied to containers. Containers were a nice bridge from our previous discussions when we were talking about container management systems. If you are interested in Linux and Linux management, Linux automation, this is a good episode for you! Transcript: https://otter.ai/u/KCK3f95lbUEAEzLgA60k-HbDlGk?utm_source ..read more
Visit website
Hello OT, Meet IT
cloud2030
by the2030.cloud Podcast
1M ago
Edge technology versus OT was the focus of discussion today, and in this conversation we cover infrastructure information technology versus operations technology, and the ongoing dilemma of edge sites specifically. This includes factories, retail locations, data center technology and 10th standard cloud with operational tech. Operational tech being vendor locked, narrowly controlled siloed technologies versus general purpose technology. In this case, we're talking about OT as specific vendor locked islands of technology versus IP, which is multipurpose, multifunction shared infrastructure tech ..read more
Visit website
Key Bridge vs Tech: Lessons Learned
cloud2030
by the2030.cloud Podcast
2M ago
In the wake of the Baltimore Key Bridge collapse, we discuss how we can improve resilience in the systems that we manage ..read more
Visit website
PXE, DHCP and O/S Provisioning (oh my)
cloud2030
by the2030.cloud Podcast
2M ago
DHCP PXE is our subject today. We cover UEFI BIOS and all of the things necessary to do network installs of servers. This incidentally includes thin clients, PCs and other network switches. Specifically, we talked about the process of having secure and robust network provisioning. We go through all the pieces that you need to know how the processes work, both in legacy and in modern current systems Transcript: https://otter.ai/u/F1u-2ipyfIZ93yp5qdzcpArLtOg?utm_source=copy_url ..read more
Visit website
XZ Exploit Discussion
cloud2030
by the2030.cloud Podcast
2M ago
This episode really highlights the danger of contributor burnout and overload. But it also shows that we're not very good as an industry at sustaining work. Today we dissect what the XZ SSH intrusion attack is, how it happened, what the social engineering was, and the pressure that involved to make that happen. Transcript: https://otter.ai/u/kRqADDwa6DmoZcnQEmqQD1UaxZ8?utm_source=copy_url References https://www.openwall.com/lists/oss-security/2024/03/29/4 https://news.ycombinator.com/item?id=39865810 https://arstechnica.com/security/2024/04/what-we-know-about-the-xz-utils-backdoor-that-almost ..read more
Visit website
Figure.AI where Robots meet LLMs
cloud2030
by the2030.cloud Podcast
2M ago
We explore the synergy of humanoid robots and LLM AI. This episode delves into how robots can learn and interpret their environment in human-like ways, based on a key video listed below. Whether or not you view the video, the discussion offers deep insights into AI's evolving role in human interaction. Transcript: https://otter.ai/u/VqiTSDMDLAKcaF1XuAH8ExhJnLE?utm_source=copy_url References: https://youtu.be/Sq1QZB5baNw?si=dAxLQIws3xkra_mf https://spectrum-ieee-org.cdn.ampproject.org/c/s/spectrum.ieee.org/amp/prompt-engineering-is-dead-2667410624 https://arxiv.org/abs/2402.17764v1 https://www ..read more
Visit website
Compliance Death Curve [Working Session 1]
cloud2030
by the2030.cloud Podcast
3M ago
The compliance death curve is something I’ve been working on as an evolving concept that tries to explain how companies fight compliance governance and standardization efforts, something that is critical to platform team and infrastructure operations. Today we try to decompose some of the mathematics that I've been using into more universal, more easily understood components. We built a compliance flywheel that I found really fascinating which you can see an example of that work in our podcast description. It could also be helpful to check out my previously recorded compliance death curve talk ..read more
Visit website
API Consumption [TechOps 003]
cloud2030
by the2030.cloud Podcast
3M ago
TechOps series episode 3 covers how to automate against API's. We discuss exactly the ways in which you can use API's effectively, and ways you can run into trouble. We also discuss how we should be consuming API's, both as a consumer but also in times when we have produced API's. Many ideas discussed were pulled from learning how people consume our API's and what we can do to help make them better and safer. Enjoy this broader TechOps series where we are diving in deep in tips and techniques that improve your journey as an Automator. https://otter.ai/u/5akxcG83FBS1m9PBUnB4rjLzWac?utm_source=c ..read more
Visit website

Follow cloud2030 on FeedSpot

Continue with Google
Continue with Apple
OR