Near-field perception for low-speed vehicle automation using surround-view fisheye cameras
Cameras are the primary sensor in automated driving systems. They provide high information density and are optimal for detecting road infrastructure cues laid out for human vision. Surround-view camera systems typically comprise of four fisheye cameras with 190°+ field of view covering the entire 360° around the vehicle focused on near-field sensing. They are the principal sensors for low-speed, high accuracy, and close-range sensing applications, such as automated parking, traffic jam assistance, and low-speed emergency braking. In this work, we provide a detailed survey of such vision systems, setting up the survey in the context of an architecture that can be decomposed into four modular components namely Recognition, Reconstruction, Relocalization, and Reorganization. We jointly call this the 4R Architecture. We discuss how each component accomplishes a specific aspect and provide a positional argument that they can be synergized to form a complete perception system for low-speed automation. We support this argument by presenting results from previous works and by presenting architecture proposals for such a system. Qualitative results are presented in the video at https://youtu.be/ae8bCOF77uY.
History
Publication
IEEE Transactions on Intelligent Transportation Systems, 2022, 23 (9) Sept. pp 13976–13993Publisher
Association for Computing MachineryRights
© ACM, 2022. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in IEEE Transactions on Intelligent Transportation Systems Volume 23 Issue 9 Sept. 2022pp 13976–13993. https://doi.org/10.1109/TITS.2021.3127646Sustainable development goals
- (9) Industry, Innovation and Infrastructure
External identifier
Department or School
- Electronic & Computer Engineering