Just-in-time AI: Has its moment arrived? [Video]

Inserting generative AI into workflows at critical points can maximize its effectiveness, while minimizing the cost. Some CIOs are enthusiastic; others are skeptical.

Credit: Tirachard Kumtanom / Shutterstock

Just as Japanese Kanban techniques revolutionized manufacturing several decades ago, similar “just-in-time” methods are paying dividends as companies get their feet wet with generative AI.

“The timeliness is critical. You don’t want to do the work too much in advance because you want that real-time context. We activate the AI just in time,” says Sastry Durvasula, chief information and client services officer at financial services firm TIAA.

TIAA has launched a generative AI implementation, internally referred to as “Research Buddy,” that pulls together relevant facts and insights from publicly available documents for Nuveen, TIAA’s asset management arm, on an as-needed basis.

“When the research analysts want the research, that’s when the AI gets activated. It takes the input from the analyst, provides the responses to analysts’ questions, and generates the report,” …