{"id":57758,"date":"2021-08-10T16:37:48","date_gmt":"2021-08-10T14:37:48","guid":{"rendered":"https:\/\/magazin.tu-braunschweig.de\/?post_type=kb_magazin&#038;p=57758"},"modified":"2023-06-07T16:51:57","modified_gmt":"2023-06-07T14:51:57","slug":"consistency-for-image-recognition-of-vehicles","status":"publish","type":"kb_magazin","link":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/","title":{"rendered":"Consistency for image recognition of vehicles"},"content":{"rendered":"<p class=\"entry\">The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim Fingscheidt, Serin Varghese, Andreas B\u00e4r and Marvin Klingner, scientists from TU Braunschweig won a Best Paper Award at one of the conference workshops for the <a href=\"https:\/\/magazin.tu-braunschweig.de\/m-post\/mehr-sicherheit-fuer-autonomes-fahren\/\">third time in a row<\/a>. Together with Volkswagen Group Automation, the researchers from the <a href=\"https:\/\/www.tu-braunschweig.de\/en\/ifn\">Institute for Communications Technology<\/a> developed a training system that enables vehicles to assess their surroundings more safely.<\/p>\n<div id=\"attachment_44539\" style=\"width: 860px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/magazin.tu-braunschweig.de\/tubs_2107_rot_ifn_01_1500\/\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-44539\" class=\"size-medium wp-image-44539\" src=\"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/TUBS_2107_ROT_IFN_01_1500-850x567.jpg\" alt=\"\" width=\"850\" height=\"567\" \/><\/a><p id=\"caption-attachment-44539\" class=\"wp-caption-text\">The three award-winning doctoral students from the Institute for Communications Technology: (from left) Marvin Klingner, Serin Varghese and Andreas B\u00e4r. Photo credit: Kristina Rottig\/TU Braunschweig.<\/p><\/div>\n<p>The workshop was about the safe use of artificial intelligence for autonomous driving. Artificial neural networks primarily process the images that autonomous vehicles take of their surroundings. They use data to automatically learn what surrounds them and how far away it is. The central method for environment perception is <a href=\"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/defend-ai-against-pixel-forgers\/\">semantic segmentation<\/a>. Here, the neural networks classify each pixel into road, car or passer-by in a fraction of a second.<\/p>\n<div id='gallery-1' class='gallery galleryid-57758 gallery-columns-2 gallery-size-thumbnail'><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<a href='https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/stuttgart_001_1500x1000.png'><img loading=\"lazy\" decoding=\"async\" width=\"400\" height=\"400\" src=\"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/stuttgart_001_1500x1000-400x400.png\" class=\"attachment-thumbnail size-thumbnail\" alt=\"A scene in road traffic as seen by the human eye. Photo credit: The Cityscapes Dataset, IfN\/TU Braunschweig.\" aria-describedby=\"gallery-1-44536\" \/><\/a>\n\t\t\t<\/dt>\n\t\t\t\t<dd class='wp-caption-text gallery-caption' id='gallery-1-44536'>\n\t\t\t\tPhoto credit: The Cityscapes Dataset, IfN\/TU Braunschweig\n\t\t\t\t<\/dd><\/dl><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<a href='https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/stuttgart_001_pred_1500x1000.png'><img loading=\"lazy\" decoding=\"async\" width=\"400\" height=\"400\" src=\"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/stuttgart_001_pred_1500x1000-400x400.png\" class=\"attachment-thumbnail size-thumbnail\" alt=\"The different coloured areas visualise how an artificial intelligence with semantic segmentation classifies the same scene. Photo credit: The Cityscapes Dataset, IfN\/TU Braunschweig.\" aria-describedby=\"gallery-1-44538\" \/><\/a>\n\t\t\t<\/dt>\n\t\t\t\t<dd class='wp-caption-text gallery-caption' id='gallery-1-44538'>\n\t\t\t\tPhoto credit: The Cityscapes Dataset, IfN\/TU Braunschweig\n\t\t\t\t<\/dd><\/dl>\n\t\t<\/div>\n\n<p>In principle, the performance of artificial intelligence in semantic segmentation is very fast and reliable. However, in the case of a video, i.e. a rapid sequence of many individual images, contradictions can occur. &#8220;For example, a cyclist can be recognised in one image and completely overlooked in the next,&#8221; explains Marvin Klingner, one of the authors. &#8220;When the computer then combines the information, it has to make a clear decision from the contradictory information. The question of which information is the correct one is particularly difficult for the computer.&#8221;<\/p>\n<h3>With the right training to consistency<\/h3>\n<p>The scientists solved the problem by forcing the neural network to be consistent over time during the learning process. As a rule, one trains here image by image and optimises the neural network in such a way that it delivers the best possible results on each individual image. In addition, the scientists used image sequences. In doing so, they sanctioned if the neural network was inconsistent in the description of the sequences. In this way, the network learns to provide temporally consistent descriptions and continuously improves in the course of the training.<\/p>\n<p>Serin Varghese, also one of the authors: &#8220;This kind of learning process is not completely new in itself. But normally the artificial intelligence would then also need videos in the input, which is very computationally expensive. The special case in our paper: you only need the videos for training and in the application it still works with single images.&#8221;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The CVPR (Conference on Computer Vision and Pattern Recognition) is &#8230; <\/p>\n","protected":false},"author":47,"featured_media":44540,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","class_list":["post-57758","kb_magazin","type-kb_magazin","status-publish","format-standard","has-post-thumbnail","hentry","kb_cat_magazin-research","kb_tags-awards","kb_tags-early-career","kb_tags-information-technology","kb_tags-mobility","kb_tags-security"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Consistency for image recognition of vehicles - TU Braunschweig | Blogs<\/title>\n<meta name=\"description\" content=\"The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Consistency for image recognition of vehicles - TU Braunschweig | Blogs\" \/>\n<meta property=\"og:description\" content=\"The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim\" \/>\n<meta property=\"og:url\" content=\"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/\" \/>\n<meta property=\"og:site_name\" content=\"TU Braunschweig | Blogs\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-07T14:51:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/TUBS_2107_ROT_IFN_01_1500.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"1000\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/\",\"url\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/\",\"name\":\"Consistency for image recognition of vehicles - TU Braunschweig | Blogs\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/wp-content\\\/uploads\\\/2021\\\/08\\\/TUBS_2107_ROT_IFN_01_1500.jpg\",\"datePublished\":\"2021-08-10T14:37:48+00:00\",\"dateModified\":\"2023-06-07T14:51:57+00:00\",\"description\":\"The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/#primaryimage\",\"url\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/wp-content\\\/uploads\\\/2021\\\/08\\\/TUBS_2107_ROT_IFN_01_1500.jpg\",\"contentUrl\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/wp-content\\\/uploads\\\/2021\\\/08\\\/TUBS_2107_ROT_IFN_01_1500.jpg\",\"width\":1500,\"height\":1000,\"caption\":\"Die drei ausgezeichneten Doktoranden des Instituts f\u00fcr Nachrichtentechnik: (v.l.) Marvin Klingner,\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/m-post\\\/consistency-for-image-recognition-of-vehicles\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Magazin\",\"item\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/m-post\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Consistency for image recognition of vehicles\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/#website\",\"url\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/\",\"name\":\"TU Braunschweig | Blogs\",\"description\":\"Die Blogs der Technischen Universit\u00e4t Braunschweig\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/magazin.tu-braunschweig.de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Consistency for image recognition of vehicles - TU Braunschweig | Blogs","description":"The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/","og_locale":"en_US","og_type":"article","og_title":"Consistency for image recognition of vehicles - TU Braunschweig | Blogs","og_description":"The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim","og_url":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/","og_site_name":"TU Braunschweig | Blogs","article_modified_time":"2023-06-07T14:51:57+00:00","og_image":[{"width":1500,"height":1000,"url":"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/TUBS_2107_ROT_IFN_01_1500.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/","url":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/","name":"Consistency for image recognition of vehicles - TU Braunschweig | Blogs","isPartOf":{"@id":"https:\/\/magazin.tu-braunschweig.de\/#website"},"primaryImageOfPage":{"@id":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/#primaryimage"},"image":{"@id":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/#primaryimage"},"thumbnailUrl":"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/TUBS_2107_ROT_IFN_01_1500.jpg","datePublished":"2021-08-10T14:37:48+00:00","dateModified":"2023-06-07T14:51:57+00:00","description":"The CVPR (Conference on Computer Vision and Pattern Recognition) is the most important conference in the field of machine vision. With Professor Tim","breadcrumb":{"@id":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/#primaryimage","url":"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/TUBS_2107_ROT_IFN_01_1500.jpg","contentUrl":"https:\/\/magazin.tu-braunschweig.de\/wp-content\/uploads\/2021\/08\/TUBS_2107_ROT_IFN_01_1500.jpg","width":1500,"height":1000,"caption":"Die drei ausgezeichneten Doktoranden des Instituts f\u00fcr Nachrichtentechnik: (v.l.) Marvin Klingner,"},{"@type":"BreadcrumbList","@id":"https:\/\/magazin.tu-braunschweig.de\/en\/m-post\/consistency-for-image-recognition-of-vehicles\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"https:\/\/magazin.tu-braunschweig.de\/en\/"},{"@type":"ListItem","position":2,"name":"Magazin","item":"https:\/\/magazin.tu-braunschweig.de\/m-post\/"},{"@type":"ListItem","position":3,"name":"Consistency for image recognition of vehicles"}]},{"@type":"WebSite","@id":"https:\/\/magazin.tu-braunschweig.de\/#website","url":"https:\/\/magazin.tu-braunschweig.de\/","name":"TU Braunschweig | Blogs","description":"Die Blogs der Technischen Universit\u00e4t Braunschweig","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/magazin.tu-braunschweig.de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/kb_magazin\/57758","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/kb_magazin"}],"about":[{"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/types\/kb_magazin"}],"author":[{"embeddable":true,"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/users\/47"}],"replies":[{"embeddable":true,"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/comments?post=57758"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/media\/44540"}],"wp:attachment":[{"href":"https:\/\/magazin.tu-braunschweig.de\/en\/wp-json\/wp\/v2\/media?parent=57758"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}