{"id":4531,"date":"2024-12-18T14:52:42","date_gmt":"2024-12-18T13:52:42","guid":{"rendered":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/"},"modified":"2025-05-22T14:17:41","modified_gmt":"2025-05-22T12:17:41","slug":"cyberagentur-will-make-ki-safer","status":"publish","type":"post","link":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/","title":{"rendered":"Cyberagentur wants to make AI safer"},"content":{"rendered":"\n

25 million euros for robust and secure machine learning<\/strong><\/h2>\n
\n
\n \"Dr.\n <\/div>\n
Dr. Daniel Gille, Projektleiter und Referatsleiter f\u00fcr K\u00fcnstliche Intelligenz bei der Cyberagentur<\/span> \n \n \n <\/figcaption>\n <\/figure>\n

The Agentur f\u00fcr Innovation in der Cybersicherheit GmbH (Cyberagentur) is launching the third phase of its “Robust and Secure Machine Learning” research program with three innovative approaches for securing AI systems. The aim is to develop tools, applications and concepts that can guarantee security even under hostile conditions. The research concentrates on applications in critical infrastructures, situation centers and open source intelligence (OSINT) and focuses in the first step on securing the data basis of neural AI systems. <\/strong><\/p>\n\n

The Agentur f\u00fcr Innovation in der Cybersicherheit GmbH (Cyberagentur) is launching the third phase of its “Robust and Secure Machine Learning” (RSML) research competition. From December 2024 to November 2025, three selected research teams will research and implement innovative approaches to the security and robustness of machine learning systems. The Cyberagentur has allocated a total budget of 25 million euros for phases 2 to 5. A final phase 6, which is scheduled to start in around three years, will be awarded to the research team with the most innovative research performance in phases 3-5 and the most convincing proposal for phase 6. <\/p>\n\n

“With the third phase of RSML, we are launching research into groundbreaking technologies that not only lay the theoretical foundations, but can also provide practical solutions for the security needs of tomorrow,” explains Dr. Daniel Gille, Project Manager and Head of Unit for Artificial Intelligence at the Cyberagentur. “Our research teams are now working on data-centric solutions to ensure security and resilience in highly sensitive application areas such as situation centers and critical network infrastructures.” <\/p>\n\n

The three consortia are focusing on the following approaches:<\/p>\n\n

    \n
  1. Modular toolkit with end-to-end assessment workflows: Development of new metrics and tools for guided development of assured ML systems.<\/li>\n\n\n\n
  2. Hybrid AI-supported Red\/Blue Team agents: These agents are designed to mutually test and secure systems in need of protection and the associated backup AIs.<\/li>\n\n\n\n
  3. Holistic framework for secure ML applications: A comprehensive verification system with threat modeling and an “RSML Operations Center” as a central interface.<\/li>\n<\/ol>\n\n

    “The development and integration of highly reliable AI systems is one of the greatest challenges of our time. Especially in safety-critical applications, these systems must not only be reliable, but also verifiably tamper-proof,” emphasizes Dr. Gille. “With the approaches of the third phase, we are focusing on data that is the foundation of all deep learning applications, including large language models and image classification systems. The data used for training is often incomplete, unrepresentative, poorly labeled or even manipulated. This is the root of many downstream security and reliability problems for which we want to find solutions.” <\/p>\n\n

    The RSML research program takes a unique approach by competitively funding research and development across multiple phases. The results are intended not only to expand the scientific basis, but also to produce prototype applications that are evaluated in realistic test environments. <\/p>\n\n

    Further information:<\/strong> https:\/\/www.cyberagentur.de\/rsml<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

    25 million euros for robust and secure machine learning The Agentur f\u00fcr Innovation in der Cybersicherheit GmbH (Cyberagentur) is launching the third phase of its “Robust and Secure Machine Learning” research program with three innovative approaches for securing AI systems. The aim is to develop tools, applications and concepts that can guarantee security even under […]<\/p>\n","protected":false},"author":11,"featured_media":4529,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[52],"tags":[],"class_list":["post-4531","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-key-technology"],"acf":[],"yoast_head":"\nCyberagentur wants to make AI safer - Cyberagentur<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Cyberagentur wants to make AI safer - Cyberagentur\" \/>\n<meta property=\"og:description\" content=\"25 million euros for robust and secure machine learning The Agentur f\u00fcr Innovation in der Cybersicherheit GmbH (Cyberagentur) is launching the third phase of its “Robust and Secure Machine Learning” research program with three innovative approaches for securing AI systems. The aim is to develop tools, applications and concepts that can guarantee security even under […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyberagentur\" \/>\n<meta property=\"article:published_time\" content=\"2024-12-18T13:52:42+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-22T12:17:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.cyberagentur.de\/wp-content\/uploads\/2024\/12\/Dr.-Daniel-Gille_300dpi.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"1000\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"ML\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"ML\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/\"},\"author\":{\"name\":\"ML\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#\\\/schema\\\/person\\\/97611132a009a9d7721aafd03e5b1942\"},\"headline\":\"Cyberagentur wants to make AI safer\",\"datePublished\":\"2024-12-18T13:52:42+00:00\",\"dateModified\":\"2025-05-22T12:17:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/\"},\"wordCount\":484,\"image\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/Dr.-Daniel-Gille_300dpi.png\",\"articleSection\":[\"Key technology\"],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/\",\"url\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/\",\"name\":\"Cyberagentur wants to make AI safer - Cyberagentur\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/Dr.-Daniel-Gille_300dpi.png\",\"datePublished\":\"2024-12-18T13:52:42+00:00\",\"dateModified\":\"2025-05-22T12:17:41+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#\\\/schema\\\/person\\\/97611132a009a9d7721aafd03e5b1942\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#primaryimage\",\"url\":\"\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/Dr.-Daniel-Gille_300dpi.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/Dr.-Daniel-Gille_300dpi.png\",\"width\":1500,\"height\":1000,\"caption\":\"Dr. Daniel Gille, Projektleiter und Referatsleiter f\u00fcr K\u00fcnstliche Intelligenz bei der Cyberagentur\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/press\\\/cyberagentur-will-make-ki-safer\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Cyberagentur wants to make AI safer\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/\",\"name\":\"Cyberagentur\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.cyberagentur.de\\\/en\\\/#\\\/schema\\\/person\\\/97611132a009a9d7721aafd03e5b1942\",\"name\":\"ML\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Cyberagentur wants to make AI safer - Cyberagentur","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/","og_locale":"en_GB","og_type":"article","og_title":"Cyberagentur wants to make AI safer - Cyberagentur","og_description":"25 million euros for robust and secure machine learning The Agentur f\u00fcr Innovation in der Cybersicherheit GmbH (Cyberagentur) is launching the third phase of its “Robust and Secure Machine Learning” research program with three innovative approaches for securing AI systems. The aim is to develop tools, applications and concepts that can guarantee security even under […]","og_url":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/","og_site_name":"Cyberagentur","article_published_time":"2024-12-18T13:52:42+00:00","article_modified_time":"2025-05-22T12:17:41+00:00","og_image":[{"width":1500,"height":1000,"url":"https:\/\/www.cyberagentur.de\/wp-content\/uploads\/2024\/12\/Dr.-Daniel-Gille_300dpi.png","type":"image\/png"}],"author":"ML","twitter_card":"summary_large_image","twitter_misc":{"Written by":"ML","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#article","isPartOf":{"@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/"},"author":{"name":"ML","@id":"https:\/\/www.cyberagentur.de\/en\/#\/schema\/person\/97611132a009a9d7721aafd03e5b1942"},"headline":"Cyberagentur wants to make AI safer","datePublished":"2024-12-18T13:52:42+00:00","dateModified":"2025-05-22T12:17:41+00:00","mainEntityOfPage":{"@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/"},"wordCount":484,"image":{"@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2024\/12\/Dr.-Daniel-Gille_300dpi.png","articleSection":["Key technology"],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/","url":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/","name":"Cyberagentur wants to make AI safer - Cyberagentur","isPartOf":{"@id":"https:\/\/www.cyberagentur.de\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#primaryimage"},"image":{"@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2024\/12\/Dr.-Daniel-Gille_300dpi.png","datePublished":"2024-12-18T13:52:42+00:00","dateModified":"2025-05-22T12:17:41+00:00","author":{"@id":"https:\/\/www.cyberagentur.de\/en\/#\/schema\/person\/97611132a009a9d7721aafd03e5b1942"},"breadcrumb":{"@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#primaryimage","url":"\/wp-content\/uploads\/2024\/12\/Dr.-Daniel-Gille_300dpi.png","contentUrl":"\/wp-content\/uploads\/2024\/12\/Dr.-Daniel-Gille_300dpi.png","width":1500,"height":1000,"caption":"Dr. Daniel Gille, Projektleiter und Referatsleiter f\u00fcr K\u00fcnstliche Intelligenz bei der Cyberagentur"},{"@type":"BreadcrumbList","@id":"https:\/\/www.cyberagentur.de\/en\/press\/cyberagentur-will-make-ki-safer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.cyberagentur.de\/en\/"},{"@type":"ListItem","position":2,"name":"Cyberagentur wants to make AI safer"}]},{"@type":"WebSite","@id":"https:\/\/www.cyberagentur.de\/en\/#website","url":"https:\/\/www.cyberagentur.de\/en\/","name":"Cyberagentur","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.cyberagentur.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/www.cyberagentur.de\/en\/#\/schema\/person\/97611132a009a9d7721aafd03e5b1942","name":"ML"}]}},"_links":{"self":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/posts\/4531","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/comments?post=4531"}],"version-history":[{"count":1,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/posts\/4531\/revisions"}],"predecessor-version":[{"id":4532,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/posts\/4531\/revisions\/4532"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/media\/4529"}],"wp:attachment":[{"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/media?parent=4531"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/categories?post=4531"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.cyberagentur.de\/en\/wp-json\/wp\/v2\/tags?post=4531"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}