Kubernetes AI solutions on the mind of Red Hat [Video]

Since KubeCon + CloudNativeCon in Paris, advancements in artificial intelligence have moved rapidly. This includes developments tied to Kubernetes AI solutions, plus advancements on bare metal and Linux in big hyperscale-type GPU deployments.

With that in mind, the enterprise has been looking toward Kubernetes in a big way. As that happens, Red Hat Inc. has been looking to respond with Kubernetes AI solutions, according to Sally O’Malley (pictured, right), principal software engineer at Red Hat Inc.

“What’s happening right now is data scientists have been doing their thing for a decade longer and us software engineers have been doing our thing,” she said. “Data scientists don’t really know a lot about containers and how to deploy things, and I don’t know a lot about data science.”

This past year, the two have come together and are creating solutions now that LLMs have entered the picture, according to O’Malley. That involves some important questions.

“How do we deploy …