A new tool from Microsoft aims to bridge the gap between application development and prompt engineering. Overtaxed AI developers take note.
Credit: NicoElNino/Shutterstock
One of the problems with building generative AI into your applications is there’s no standard way of managing prompts. Too often, each team that builds AI into their code takes a different approach and manages data in different ways. They’re reinventing the wheel again and again, failing to learn from other teams and other projects.
Building a new AI interaction model for each application and having different ways of storing, using, and updating prompts wastes time. AI developer resources are limited, and experienced developers are stretched across multiple projects. It’s not effective to have to remember how each application works and how they need to structure and test prompts.
Using different AI models adds complexity. A team may be using a large language model (LLM) like Open AI’s GPT, …