Abstract
Visual search, that is, the simultaneous localization and detection of a visual target of interest, is a vital task. Applied to the case of natural scenes, searching for example to an animal (either a prey, a predator or a partner) constitutes a challenging problem due to large variability over numerous visual dimensions such as shape, pose, size, texture or position. Yet, biological visual systems are able to perform such detection efficiently in briefly flashed scenes and in a very short amount of time.Deep convolutional neuronal networks (CNNs) were shown to be well fitted to the image classification task, providing with human (or even super-human) performance. Previous models also managed to solve the visual search task, by roughly dividing the image into sub-areas. This is at the cost, however, of computer-intensive parallel processing on relatively low-resolution image samples. Taking inspiration from natural vision systems, we develop here a model that builds over the anatomical visual processing pathways observed in mammals, namely the What and the Where pathways. It operates in two steps, one by selecting regions of interest, before knowing their actual visual content, through an ultra-fast/low resolution analysis of the full visual field, and the second providing a detailed categorization over the detailed foveal selected region attained with a saccade.
- This work extends to natural scenes a previous work on visual search on a simplified task formulated in
- It is based on a first work on transfer learning and its application to a natural task :(2023). Ultra-Fast Image Categorization in biology and in neural models. Vision.
- in particular, we found retinotopic mapping to be adapted to that extension :(2022). Retinotopic mapping improves the reliability of image classification. NeuroVision Workshop in conjunction with CVPR 2022.
- for a follow-up, check out(2023). Retinotopic Mapping Enhances the Robustness of Convolutional Neural Networks. Submitted.
Jean-Nicolas Jérémie
Phd candidate in Computational Neuroscience
During my PhD, I am focusing on ultra-fast processing in event-based neural networks.
Laurent U Perrinet
Researcher in Computational Neuroscience
My research interests include Machine Learning and computational neuroscience applied to Vision.