A Great First Milestone for HEGEMON

28 October 2026

A great first milestone for HEGEMON — Holistic Evaluation of Generative Foundation Models in a Security Context.

Our consortium, consisting of dida and two teams from the University of the Bundeswehr Munich, achieved first place in both the technical benchmarking and the stakeholder jury evaluation during the project’s first phase.

The UniBw Munich teams are the Earth Observation group, led by Prof. Dr. Michael Schmitt, and our AIML group, led by Prof. Dr. Eirini Ntoutsi and represented in the project by Manolis Panagiotou and Tobias Callies.

HEGEMON follows a competitive cross-evaluation setup: four teams address the same security-related use cases, adapt foundation models, and develop their own benchmarks. Each model is then evaluated against the test suites developed by all participating teams.

For our AIML group, this provides an exciting testbed for a central research question: How can we move beyond isolated scores towards a holistic, trustworthy, and context-aware evaluation of foundation models?

Many thanks to the entire consortium and the Agentur für Innovation in der Cybersicherheit GmbH (Cyberagentur) for the successful collaboration. We look forward to the next phase!

Further information is available in dida’s announcement of the evaluation results.