SYNTHIA Dataset swMATH ID: 35060 Software Authors: Ros, G.; Sellart, L.; Materzynska, J.; Vazquez, D.; Lopez, A.M Description: The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes. Vision-based semantic segmentation in urban scenarios is a key functionality for autonomous driving. Recent revolutionary results of deep convolutional neural networks (DCNNs) foreshadow the advent of reliable classifiers to perform such visual tasks. However, DCNNs require learning of many parameters from raw images, thus, having a sufficient amount of diverse images with class annotations is needed. These annotations are obtained via cumbersome, human labour which is particularly challenging for semantic segmentation since pixel-level annotations are required. In this paper, we propose to use a virtual world to automatically generate realistic synthetic images with pixel-level annotations. Then, we address the question of how useful such data can be for semantic segmentation - in particular, when using a DCNN paradigm. In order to answer this question we have generated a synthetic collection of diverse urban images, named SYNTHIA, with automatically generated class annotations. We use SYNTHIA in combination with publicly available real-world urban images with manually provided annotations. Then, we conduct experiments with DCNNs that show how the inclusion of SYNTHIA in the training stage significantly improves performance on the semantic segmentation task. Homepage: https://ieeexplore.ieee.org/document/7780721 Related Software: ImageNet; Cityscapes; KITTI; PASCAL VOC; Mapillary Vistas; U-Net; DeepLab; Mask R-CNN; AlexNet; MS-COCO; Adam; BDD100k; RefineNet; ShapeNet; Faster R-CNN; GitHub; CamVid; ParseNet; ADE20k; DeconvNet Cited in: 6 Documents all top 5 Cited by 22 Authors 1 Ahsan, Unaiza 1 Behnke, Sven 1 Burgard, Wolfram 1 Chidlovskii, Boris 1 Csurka, Gabriela 1 Dos Santos, Jefersson A. 1 Hagen, Matthew 1 Kot, Alex Chichung 1 Li, Hanyan 1 Li, Haoliang 1 Machado, Gabriel L. S. 1 Mohan, Rohit 1 Nogueira, Keiller 1 Oliveira, Hugo Luiz 1 Quenzel, Jan 1 Rosu, Radu Alexandru 1 Silva, Caio 1 Valada, Abhinav 1 Volpi, Riccardo 1 Wan, Renjie 1 Wang, Shiqi 1 Wang, Yuanbo Cited in 3 Serials 3 International Journal of Computer Vision 2 Foundations and Trends in Computer Graphics and Vision 1 Machine Learning Cited in 1 Field 6 Computer science (68-XX) Citations by Year