Enterprise teams have moved past early experimentation. Pilots succeed, prototypes impress, and individual teams deliver initial results. The challenge every platform engineering and ITOps team hits next is much harder: operating AI with the same operational rigor as mission-critical AI infrastructure. Moving beyond isolated development sandboxes requires answering 4 questions before scaling: Can we trust it? Can we control it? Can we build on it? Can we measure it?
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile
Articles by Will McGrath
I Spent My Summer in the Cemetery. There, I Found Strange Solace
Ian Kline for The New York Times In June, my family and I hiked out to a pioneer cemetery near Duluth, Minn., along the cascading St. Louis River. The wall of trees opened onto a clearing that was studded with crumbling tombstones and strange, squat obelisks. “Why are we here again?” my 9-year-old asked. She has auburn hair chopped at the jawline and believes fervently in magic.
Un verano entre cementerios me dejó un extraño consuelo
Ian Kline para The New York Times En junio, mi familia y yo caminamos hasta un cementerio de pioneros cerca de Duluth, Minnesota, junto al caudaloso río Saint Louis. El muro de árboles se abría a un claro salpicado de lápidas en ruinas y extraños y gruesos obeliscos. “¿Por qué estamos aquí otra vez?”, preguntó mi hija de 9 años. Ella tiene el pelo castaño rojizo cortado a la altura de la mandíbula y cree fervientemente en la magia.
Opinion: I spent my summer in the cemetery. There, I found strange solace.
In June, my family and I hiked out to a pioneer cemetery near Duluth, Minn., along the cascading Saint Louis River. The wall of trees opened onto a clearing that was studded with crumbling tombstones and strange, squat obelisks. “Why are we here again?” my 9-year-old asked. She has auburn hair chopped at the jawline and believes fervently in magic. At her question, my 14- and 16-year-olds sighed and cast their gaze skyward, in a way that conveyed the great depths of their filial respect.
Un verano entre cementerios me dejó un extraño consuelo
You have a preview view of this article while we are checking your access. When we have confirmed access, the full article content will load. En junio, mi familia y yo caminamos hasta un cementerio de pioneros cerca de Duluth, Minnesota, junto al caudaloso río Saint Louis. El muro de árboles se abría a un claro salpicado de lápidas en ruinas y extraños y gruesos obeliscos. “¿Por qué estamos aquí otra vez?”, preguntó mi hija de 9 años.
I Spent My Summer in the Cemetery. There, I Found Strange Solace.
In June, my family and I hiked out to a pioneer cemetery near Duluth, Minn., along the cascading Saint Louis River. The wall of trees opened onto a clearing that was studded with crumbling tombstones and strange, squat obelisks. “Why are we here again?” my 9-year-old asked. She has auburn hair chopped at the jawline and believes fervently in magic. At her question, my 14- and 16-year-olds sighed and cast their gaze skyward, in a way that conveyed the great depths of their filial respect.
Scaling enterprise AI: Delivering Models-as-a-Service with Red Hat OpenShift AI 3.4
Discover how Red Hat OpenShift AI 3.4 and Red Hat Connectivity Link deliver Models-as-a-Service (MaaS) to centrally govern and scale enterprise AI model serving. Many enterprises have moved past the AI pilot phase. Models are running in production and teams are consuming them, but now they're hitting the governance wall. Who controls which team can access which model? Who approved that inference endpoint for customer-facing use?
The USA Ultimate Masters Championships
- - - FEATURES: Middle-aged athletes Scoobers Coke Slurpees The unknowable future - - - In July of 2025, I flew out to Aurora, Colorado, with my wife and some friends to see if we were still the best forty-something ultimate frisbee players in the United States of America. We’d been training for months, and for decades.
Opinion | How We Resist ICE: Car Pools
In the resistance we drive minivans, we take ’em low and slow down Nicollet Avenue, our trunks stuffed with hockey skates and scuffed Frisbees and cardboard Costco flats. We drive Odysseys and Siennas, we drive Voyagers and Pacificas, we like it when the back end goes ka-thunk over speed bumps, shaking loose the Goldfish dust. One of our kids wrote “wash me”on the van’s exterior, etched it into the gray scurf of frozen Minneapolis slush. Our floor mats smell like mildew from the snowmelt.
Solving the scaling challenge: 3 proven strategies for your AI infrastructure
Every team that starts experimenting with generative AI (gen AI) eventually runs into the same wall: scaling it. Running 1 or 2 models is simple enough. Running dozens, supporting hundreds of users, and keeping GPU costs under control, is something else entirely. Teams often find themselves juggling hardware requests, managing multiple versions of the same model, and trying to deliver performance that actually holds up in production.
Why standardization is the key to agentic AI success: How a unified platform spurs innovation
You're tasked with bringing AI into your organization, but the journey from a proof-of-concept to a production-ready application is often a maze of fragmented tools and complex integrations, especially for agentic AI use cases. The real challenge isn't just the technology—it's building an AI strategy that is scalable, reliable, and manageable. Standardization is a primary factor in meeting this challenge, primarily by reducing complexity and increasing efficiency.
Red Hat AI 3 delivers speed, accelerated delivery, and scale
This past May at Red Hat Summit, we made several announcements across the Red Hat AI portfolio, including the introduction of Red Hat AI Inference Server and Red Hat AI third-party validated models, the integration of Llama Stack and Model Context Protocol (MCP) APIs as a developer preview, and the establishment of the llm-d community project. The portfolio’s latest iteration, Red Hat AI 3, generally available in November, delivers many of these production-ready capabilities for enterprises.
DenizBank drives AI innovation with Red Hat OpenShift AI
In the competitive world of modern finance, staying ahead means embracing innovation. For DenizBank, one of Türkiye's leading private banks, this means a strong commitment to integrating artificial intelligence (AI) and machine learning (ML) into the core of its operations. Driving this technological evolution within DenizBank is Intertech, DenizBank's IT subsidiary, which has played a key role in redefining what's possible in banking.
Sharing is caring: How to make the most of your GPUs part 2 - Multi-instance GPU
In the part one about fractional GPUs, we talked about time slicing as "carpooling" for your GPU – getting more people (processes) into the same car (GPU) to use it more efficiently. In this second strategy, called multi-instance GPU (MIG) partitioning, imagine that for the same "carpooling" we get numbered and sized seats for each person so everyone knows where to sit and where they fit.
Sharing is caring: How to make the most of your GPUs (part 1 - time-slicing)
As artificial intelligence (AI) applications continue to advance, organizations often face a common dilemma: a limited supply of powerful graphics processing unit (GPU) resources, coupled with an increasing demand for their utilization. In this article, we'll explore various strategies for optimizing GPU utilization via oversubscription across workloads in Red Hat OpenShift AI clusters.
Oracle, SUSE Tussle with Red Hat over the Business of Open Source
There’s nothing like a good kerfuffle between tech giants, especially when it’s about something as near and dear to developers’ hearts as open source software development. Which is probably why the ongoing controversy around Red Hat‘s decision to limit the availability of the source code to its flagship Red Hat Enterprise Linux (RHEL) distro.
How AI Will Change Frontend and APIs
Lyman dismissed the sci-fi notions that large language models and generative AI are in any way intelligent, calling them “pattern printers” that are just “our own babbling mirrored back to us.” Instead, we should look at their potential to be a new type of user interface, he contended. “As a replacement for human beings, they fall short,” Lyman wrote. “But as a replacement for, say, a command-line interface?
Programmers Share Tips and Tricks for Working with AI
“With the current hype around generative AI, we didn’t want to offer more fodder for AI doomscrolling,” Caballar told me in an email interview. While acknowledging the site “has been covering the threats to coding over the past few years” (such as no code and AI) this time they found an optimistic angle.
Learning to Love Generative AI in Software Development
Software is an extraordinary engine of economic growth and change because it abstracts and automates both workflows and the functions of prototypes and machines, cheaply and at scale. Now, generative artificial intelligence is being used in the creation of software by many companies. We are turning the power of software and AI on software creation itself.
HashiCorp Acquires BluBracket to Boost 'Lifecycle' Secrets Management
Seeking to enhance its supply chain security capabilities, HashiCorp has acquired the startup BluBracket. BluBracket specializes in repository and source library security for remote access, which would complement HashiCorp’s own Vault-based security capabilities. In the short term, HashiCorp’s primary focus lies on managing Vault’s secrets more effectively with BluBracket for the management of secrets throughout their entire lifecycle.
What's Holding up WebAssembly's Adoption?
The promise for WebAssembly is this: Putting applications in WebAssembly (Wasm) modules can improve their runtime performance and lower latency speeds, while improving compatibility across the board. WebAssembly requires only a CPU instruction set.
Using LLM-Assisted Coding to Write a Custom Template Function
In this series of articles I’ll explore LLM-assisted coding through a particular lens: my own experience as an average developer, working in and around an open source codebase, chronicling the ways in which LLM assistants do (or don’t!) make me better at various tasks. I’ve been coding for decades, more as a toolsmith than a production developer; tasks in my lane have typically been feature prototypes, automation scripts, data analysis, document processing.
How We Built an MLOps Platform and the Lessons We Learned
Sometimes the best solutions are the ones that come together unexpectedly. That’s always been true in the open source community. We’ve become accustomed to witnessing some of the most innovative technologies emerge from simple projects originally intended to do one thing but then ended up doing so much more.
CIOs, Heed On-Premises App and Infrastructure Performance
Although legacy applications and infrastructure may not be a popular topic, their significance to organizations is crucial. As cloud native technologies are poised to become a dominant part of computing, certain applications and infrastructure must remain on premises, particularly in regulated and other industries.
Why Developers Hate Jira - and What Atlassian Is Doing About It
For those who work in tech, there are three certainties: Death, taxes, and grumbles about working with Jira. First arriving on the scene in 2002, Jira — short for “Gojira,” the original Japanese name of Godzilla — quickly became the de facto standard for helping programmers and product managers track bugs in their software. Australia-based Atlassian saw its star rise alongside Jira’s, leading its growth into the $45 billion publicly-traded juggernaut it is today.
What Is DevSecOps?
DevSecOps definition: DevSecOps is a software development approach that integrates security practices into the DevOps methodology. It emphasizes the collaboration and cooperation of development, operations and security teams throughout the entire software development life cycle. What Does DevSecOps Stand for? What does the term DevSecOps refer to? The Dev in DevSecOps is short for Development. Sec refers to Security. And the Ops stands for Operations.
The Pros (And Con) of Customizing Large Language Models
Before the artificial intelligence collective destroy humanity, it’s going to have to settle a few things in its own house first. For instance: Which is better — a large language model (LLM) or a custom-trained LLM? Tabnine’s is team custom-trained, while its primary competitor — GitHub Copilot — is driven by the more broadly trained LLM GPT-4. The company added chat functionality to its AI-powered assistant for developers last week.
Python Gets Its Mojo Working for AI
Could Mojo really speed up Python code by a factor of 3,500? This is a claim being made about this new superset of Python, one tweaked for performance in the artificial intelligence (AI) space. Python, like all things software related, is fallible. But now, with open data, and AI development systems exploding in size scope, the drive to solve Python’s performance issues is intensifying.
Rod Garcia
Cookie Policy When you visit, the website may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device, but does not usually directly identify you. The information is mostly used to make the website display the embedded content you expect to see and work the way you expect it to. These cookies are necessary for the website to function and cannot be switched off in our systems.
Will McGrath
Cookie Policy When you visit, the website may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device, but does not usually directly identify you. The information is mostly used to make the website display the embedded content you expect to see and work the way you expect it to. These cookies are necessary for the website to function and cannot be switched off in our systems.
Jorge Lainfiesta
Cookie Policy When you visit, the website may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device, but does not usually directly identify you. The information is mostly used to make the website display the embedded content you expect to see and work the way you expect it to. These cookies are necessary for the website to function and cannot be switched off in our systems.
Fendy Feng
Cookie Policy When you visit, the website may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device, but does not usually directly identify you. The information is mostly used to make the website display the embedded content you expect to see and work the way you expect it to. These cookies are necessary for the website to function and cannot be switched off in our systems.
A guide to fine-tuning and serving AI/ML foundation models
Generative AI products such as OpenAI’s ChatGPT and DALL-E have generated excitement around large foundation models that train on massive amounts of broad data to create impressive textual, visual, and audio content. The buzz around generative AI has been so great because its benefits are easily understood. The movement towards open sourcing foundation models is increasing in popularity because of the potential ethical issues associated with AI.
Building GPT Applications on Open Source LangChain, Part 2
This is the second of two articles. In the previous article, we discussed three considerations for developers when building GPT applications with an open source stack, such as LangChain. Let’s now use LangChain for a practical example where we want to store and analyze PDF documents. We’ll obtain a PDF document, divide it into smaller parts, save the document text and its vector representations (embeddings*) in a database system and then query it. We’ll also use a GPT to help answer a question.
Signs You Have Outgrown Your Mobile Monitoring Solution
Imagine you start a new hobby — let’s say bike riding. You don’t want to invest a lot in a bike because you’re not sure that you’ll like it. Luckily, you snag a free bike from a friend. It’s clunky, but the price is right. You start out with short rides around your neighborhood and eventually find yourself riding every day, going on longer and longer rides. Your free, heavy bike is holding you back. Now that you’re cycling more seriously, it’s time for a better bike. Mobile monitoring is like that.
Can Companies Really Self-Host at Scale?
There’s no such thing as free lunch, or in this case, free software. It’s a myth. Paul Vixie, vice president of security at Amazon Web Services, creator of the original Domain Name System (DNS), gave a compelling presentation at Open Source Summit Europe 2022 about this topic. His presentation included a comprehensive list of “dos and don’ts” for consumers of free software.
Reducing Complexity with a Multimodel Database
“Future users of large data banks must be protected from having to know how the data is organized in the machine (the internal representation).” With these words, E.F. Codd (known as “Ted” to his friends) began the seminal paper that begat the “relational wave” that would spend the next 50 years dominating the database landscape.
A CTO’s Guide to Navigating the Cloud Native Ecosystem
While container and cloud technology are increasingly mature, there are still a lot of different software, staffing and architecture considerations that CTOs must address to ensure that everything runs smoothly and operates together. The Gartner “A CTO’s Guide to Navigating the Cloud Native Container Ecosystem” report estimates that by 2028, more than 95% of global organizations will be running containerized applications in production, which is a significant increase from fewer than 50% in 2023.
Survey Says: Cloud Maturity Matters
The third annual State of Cloud Strategy Survey, commissioned by HashiCorp and conducted by Forrester Consulting, focuses on operational cloud maturity — defined not by the amount of cloud usage but by adoption of a combination of technology and organizational best practices at scale.
Is the Answer to Your Data Science Needs Inside Your IT Team?
The demand for data scientists is at a fever pitch. A 2022 survey revealed that insufficient talent or headcount is the biggest barrier to the successful enterprise adoption of data science. But there might be a better option than trying to compete for talent on the open market: upskilling and cultivating data science talent from within your team.
Expanding OpenShift Data Science Support for On-Premise Deployments
On the heels of the general availability of the Red Hat OpenShift Data Science cloud service a little more than a month ago, we’re excited to announce the GA of a self-managed software version. Red Hat OpenShift Data Science (RHODS) is an easy-to-configure MLOps platform for building and deploying AI/ML models and intelligent applications.
Object Detection with Red Hat OpenShift Data Science and Red Hat OpenShift Service on AWS Running on 3rd Generation Intel® Xeon® Scalable Processor Based Instances at AWS re:Invent
This is a guest post written in collaboration with Intel's Sridhar Kayathi : Global Ecosystem Development Manager Artificial intelligence (AI), machine learning (ML), and deep learning (DL) have rapidly become critical for businesses and organizations. Deploying these technologies, however, can be complicated.
Will McGrath on Traveling Through Rural Maine With Young Children
We found ourselves up in timber, Sam four, Eve two, the three of us hung between banks of Maine pine, out on a suspension footbridge humming like picture wire. The Androscoggin churned beneath us, engorged with melt, and from the bridge we watched a lost blue oil drum nod along toward big rocks downriver, where the water tore itself to shreds, became confetti, a dirty white celebration thrown for these early days of spring.
Review: 'Farewell Transmission,' by Will McGrath
Why do those of us who love to travel love to travel?
Why Open Source Is a Catalyst for Effective MLOps
Open source software has been behind some of the biggest technological and procedural innovations of the past decade. Its customizability and interoperability are ideal for connecting different technologies and teams and makes it an “engine of innovation.” Indeed, it’s hard to imagine the cloud, developer operations (DevOps), or containers emerging from a world without open source.
Driving Innovation with open source AI/ML
Red Hat’s AI cloud service platform almost didn’t happen. And all the benefits it provides—enabling a curated and supported Jupyter-as-a-service platform that IT operations can provide to their organization’s data scientists and intelligent application developers while still maintaining control—would not have been possible.
Simplifying Managed Database Access on OpenShift
Introduction The introduction of containers and container orchestration has made it easier to deploy and update applications. The growing popularity of database cloud service offerings has also simplified the development and deployment of stateful cloud native applications. But developers often access these database services in many different ways, dealing with a myriad of security credentials, which the developer often gets from their IT counterparts.
3 Strategies for Creating a Successful MLOps Environment
Read more about author Will McGrath. Disconnects between development, operations, data engineers, and data science teams might be holding your organization back from extracting value from its artificial intelligence (AI) and machine learning (ML) processes. In short, you may be missing the most essential ingredient of a successful MLOps environment: collaboration.
Filebase Migrates Data from S3 to Decentralized Storage
One of the challenges that exist for all development environments is data availability — whether it’s on a storage array in your data center or stored in cloud object storage like Amazon S3. If connectivity between that storage and the user is severed in some way, it’s no longer accessible.
Don’t Let Storage Slow You Down
Red Hat sponsored this post. Will McGrath Will is a Product Marketing Manager within the Cloud Storage and Data Services business unit at Red Hat, where he creates joint solution programs for hybrid cloud offerings. He has more than 30 years of experience in the IT industry. Before Red Hat, Will worked for 12 years as strategic alliances manager for media and entertainment technology partners.
Show More
loading
Actions
Is this you?
As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.Get in touch with Will
Contact Will, search articles and posts on X, monitor coverage, and track replies from one place.
Learn more about Muck Rack