{"id":5197,"date":"2025-06-05T19:18:15","date_gmt":"2025-06-05T17:18:15","guid":{"rendered":"https:\/\/www.cyberagentur.de\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/"},"modified":"2025-06-05T19:18:45","modified_gmt":"2025-06-05T17:18:45","slug":"holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon","status":"publish","type":"tender","link":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/","title":{"rendered":"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON)"},"content":{"rendered":"\n<p><strong>Description:<\/strong> The term foundation model describes complex neural networks that have been trained on large amounts of data and are characterized by a high degree of generality and versatility in their possible applications. For this purpose, the models have a large number of parameters (several hundred billion) that are learned during training. The implicit knowledge acquired from the data is represented in the parameters and thus represents the basis (foundation) for further possible applications. Generative foundation models differ from previous AI models in that they generate complex text, image or audio content (or a combination of these) on the basis of free input (prompts) and can therefore be used for a wide range of complex tasks. The initial training effort for such models is extremely high and therefore time- and resource-intensive.    <\/p>\n\n<p>With the paradigm shift from mostly unimodal models with narrowly defined functionality to generative models with self-monitored learning of huge multimodal data volumes, the field of application of the technology has been significantly expanded. At the same time, however, evaluation has also become much more complex. While measurements using quantitative approaches are possible for classic regression, classification and structure recognition tasks, qualitative approaches covering multiple property dimensions are necessary for complex generative tasks. Problems such as the invention of facts and sources in large language models (\u201challucinating\u201d), the possibility of manipulatively inducing unintended model behavior (through direct or indirect prompt injection), the perpetuation of stereotypes from the training data in the model output (bias) and the high computing power required for inference make a holistic evaluation all the more necessary if use in sub-domains of internal and external security is envisaged. Previous approaches are not sufficiently suitable for use in a German-speaking context and in consideration of security domain-specific tasks.    <\/p>\n\n<p>Against this background, the aim of the procedure is to provide innovative research and development services in a competitive framework (\u201cchallenge\u201d) for the holistic evaluation of generative foundation models in a security context.<\/p>\n\n<p><strong>Awarding body: <\/strong>Agentur f\u00fcr Innovation in der Cybersicherheit GmbH<br\/><strong>Services and products:<\/strong> Research and development services and related consulting<br\/><strong>Tender scope:<\/strong> EU member states, Switzerland, NATO member state or NATO partner, in particular AP4 (Asia-Pacific Partner &#8211; South Korea, Japan, Australia and New Zealand)<br\/><strong>Procurement procedure:<\/strong> Pre-commercial procurement<br\/><strong>Type of award:<\/strong> Based on a negotiated procedure with a call for competition<br\/><strong>Deadline for submission of requests to participate + outline:<\/strong> <strong>31.07.2025, 10:00 a.m.<\/strong>, via <a href=\"https:\/\/deu01.safelinks.protection.outlook.com\/?url=https%3A%2F%2Fwww.evergabe-online.de%2F&amp;data=05%7C02%7Clindner%40cyberagentur.de%7Ca8655110908d42686c0008dc3380f29b%7C5af5addd67a84166a44ea46bb97cdde2%7C0%7C0%7C638441876120818478%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=mjDc9hRmxFM%2F4rqRu3VtiB%2BP1UFTDR0NzPh1eO1jdMI%3D&amp;reserved=0\" target=\"_blank\" rel=\"noreferrer noopener\">www.evergabe-online.de <\/a>or directly <a href=\"https:\/\/ted.europa.eu\/de\/notice\/-\/detail\/358520-2025\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/ted.europa.eu\/de\/notice\/-\/detail\/358520-2025<\/a><br\/><strong>Place of fulfillment:<\/strong> Halle (Saale), district-free city<br\/><strong>Contact:<\/strong> only via <a href=\"https:\/\/deu01.safelinks.protection.outlook.com\/?url=http%3A%2F%2Fwww.evergabe-online.de%2F&amp;data=05%7C02%7Clindner%40cyberagentur.de%7Ca8655110908d42686c0008dc3380f29b%7C5af5addd67a84166a44ea46bb97cdde2%7C0%7C0%7C638441876120834805%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=cyz7SzL3XUfUKcqPsbRrE7EvGI7lAuHUW%2Fj%2FC3yJG6o%3D&amp;reserved=0\" target=\"_blank\" rel=\"noreferrer noopener\">www.evergabe-online.de<\/a><br\/><strong>Contract notice number TED:  <\/strong><a href=\"https:\/\/ted.europa.eu\/de\/notice\/-\/detail\/358520-2025\" target=\"_blank\" rel=\"noreferrer noopener\"><\/a><strong>358520-2025<\/strong><br\/><strong>CPV code:<\/strong> 73000000<\/p>\n\n<p><strong>More information on the research program:<\/strong> <a href=\"https:\/\/www.cyberagentur.de\/en\/programs\/hegemon\/hegemon-2\/\">https:\/\/www.cyberagentur.de\/programme\/hegemon\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Description: The term foundation model describes complex neural networks that have been trained on large amounts of data and are characterized by a high degree of generality and versatility in their possible applications. For this purpose, the models have a large number of parameters (several hundred billion) that are learned during training. The implicit knowledge [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","class_list":["post-5197","tender","type-tender","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON) - Cyberagentur<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON) - Cyberagentur\" \/>\n<meta property=\"og:description\" content=\"Description: The term foundation model describes complex neural networks that have been trained on large amounts of data and are characterized by a high degree of generality and versatility in their possible applications. For this purpose, the models have a large number of parameters (several hundred billion) that are learned during training. The implicit knowledge [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyberagentur\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-05T17:18:45+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/tenders\\\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\\\/\",\"url\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/tenders\\\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\\\/\",\"name\":\"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON) - Cyberagentur\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#website\"},\"datePublished\":\"2025-06-05T17:18:15+00:00\",\"dateModified\":\"2025-06-05T17:18:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/tenders\\\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/tenders\\\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/tenders\\\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/\",\"name\":\"Cyberagentur\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON) - Cyberagentur","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/","og_locale":"en_GB","og_type":"article","og_title":"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON) - Cyberagentur","og_description":"Description: The term foundation model describes complex neural networks that have been trained on large amounts of data and are characterized by a high degree of generality and versatility in their possible applications. For this purpose, the models have a large number of parameters (several hundred billion) that are learned during training. The implicit knowledge [&hellip;]","og_url":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/","og_site_name":"Cyberagentur","article_modified_time":"2025-06-05T17:18:45+00:00","twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/","url":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/","name":"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON) - Cyberagentur","isPartOf":{"@id":"https:\/\/www.cyberagentur.de\/en\/#website"},"datePublished":"2025-06-05T17:18:15+00:00","dateModified":"2025-06-05T17:18:45+00:00","breadcrumb":{"@id":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.cyberagentur.de\/en\/tenders\/holistische-evaluation-generativer-foundation-models-im-sicherheitskontext-hegemon\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.cyberagentur.de\/en\/"},{"@type":"ListItem","position":2,"name":"Holistic Evaluation of Generative Foundation Models in the Security Context (HEGEMON)"}]},{"@type":"WebSite","@id":"https:\/\/www.cyberagentur.de\/en\/#website","url":"https:\/\/www.cyberagentur.de\/en\/","name":"Cyberagentur","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.cyberagentur.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"}]}},"_links":{"self":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/tenders\/5197","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/tenders"}],"about":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/types\/tender"}],"version-history":[{"count":1,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/tenders\/5197\/revisions"}],"predecessor-version":[{"id":5198,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/tenders\/5197\/revisions\/5198"}],"wp:attachment":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/media?parent=5197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}