LatticeFlow launches first comprehensive evaluation framework for compliance with the EU AI Act [Video]

The platform has so far ranked models from OpenAI, Meta, Mistral, Anthropic, and Google on more than two dozen technical specifications.

Credit: Shutterstock

The European Union (EU) AI Act, passed in August, has been touted as a milestone for AI development.

However, the framework has also been criticized as being vague, non-technical, and broad. Although it identifies six ethical principles, these haven’t been translated into codified benchmarks, and there have yet to be any concrete standards or recommendations issued.

To help provide some clarity and give AI makers a grasp of how well their models may fare, LatticeFlow, ETH Zurich, and the Institute for Computer Science, Artificial Intelligence and Technology (INSAIT) Wednesday announced Compl-AI. They call it the first evaluation framework for determining compliance with the AI Act.

The site has so far ranked models from the likes of OpenAI, Meta, Mistral, Anthropic and Google on more than two dozen technical specifications. …