Artificial neural networks and machine learning applied to the understanding of biological vision
Laurent Perrinet
[2024-05-13]Master M4NC de l’institut NeuroMod, cours Prospective Innovation and Research
Principles of Vision
]](https://outde.xyz/img/Rawski/Marr/3Lvls.jpg)
What is the function of vision?
](https://www.cabinetmagazine.org/issues/30/cabinet_030_archibald_sasha_001.jpg)
What is the function of vision?
](https://www.cabinetmagazine.org/issues/30/cabinet_030_archibald_sasha_002.jpg)
What is the function of vision?
](https://www.cabinetmagazine.org/issues/30/cabinet_030_archibald_sasha_003.jpg)
What is the function of vision?
](https://www.cabinetmagazine.org/issues/30/cabinet_030_archibald_sasha_006.jpg)
Visual illusions
](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/42_rotsnakes_main.jpg)
Visual illusions
Visual illusions
](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/Hering_illusion_without.svg)
Visual illusions
](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/Hering_illusion.svg)
Visual illusions
Visual illusions : Pareidolia
)](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/Face-on-mars.jpg)
Visual illusions : Pareidolia
)](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/Viking_moc_face_20m_low.png)
Visual illusions : Pareidolia
)](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/Viking_moc_face_20m_high.png)
Principles of vision?
Computational neuroscience of vision
Computational neuroscience of vision
]](https://github.com/laurentperrinet/2019-04-03_a_course_on_vision_and_modelization/raw/master/figures/Churchland92.png)
Anatomy of the Human Visual system
Human Visual system : the HMAX model
]](https://i.stack.imgur.com/ZlFnp.png)
Primary visual cortex
![[Hubel & Wiesel, 1962]](https://github.com/laurentperrinet/2019-04-03_a_course_on_vision_and_modelization/raw/master/figures/scientists.jpg)
Primary visual cortex
[Hubel & Wiesel, 1962]
Convolutional Neural Nets (CNN)
]](https://laurentperrinet.github.io/2019-04-03_a_course_on_vision_and_modelization/figures/boutin-franciosini-ruffier-perrinet-19_figure1_a.svg)
Convolutional Neural Nets (CNN)
]](https://www.mdpi.com/vision/vision-07-00029/article_deploy/html/images/vision-07-00029-g003.png)
CNN: Mathematics
- One-dimensional discrete convolution (eg in time) with a kernel $g$ of radius $K$: $$ (f \ast g)[n]=\sum_{m=-K}^{K} f[n-m] \cdot g[m] $$
CNN: Mathematics
- Convolution of an image (two-dimensional) with a kernel $g$ of radius $K\times K$:
$$ (f \ast g)[x, y] = \sum_{i=-K}^{K} \sum_{j=-K}^{K} f[x-i, y-j] \cdot g[i, j] $$
CNN: Mathematics
- Cross-correlation of an image (two-dimensional) with a kernel $g$ of radius $K\times K$:
$$ (f \ast \tilde{g})[x, y] = \sum_{i=-K}^{K} \sum_{j=-K}^{K} f[x+i, y+j] \cdot g[i, j] $$
CNN: Mathematics
]](https://stanford.edu/~shervine/teaching/cs-230/illustrations/convolution-layer-a.png)
CNN: Mathematics
- Correlation of an image defined on several channels (note the order of the indices):
$$ (f \ast \tilde{g})[x, y] = \sum_{c=1}^{C} \sum_{c,i,j} f[c, x+i, y+j] \cdot g[c, i, j] $$
CNN: Mathematics
- Correlation of a multi-channel image for multiple output channels (note the order of the indices):
$$ (f \ast \tilde{g})[k, x, y] = \sum_{c,i,j} f[c, x+i, y+j] \cdot g[k, c, i, j] $$
CNN: the HMAX model
CNN: challenges
CNN: Predictive processing
]](https://laurentperrinet.github.io/2019-04-03_a_course_on_vision_and_modelization/figures/boutin-franciosini-ruffier-perrinet-19_figure1.svg)
CNN: Predictive processing
]](https://laurentperrinet.github.io/publication/boutin-franciosini-chavane-ruffier-perrinet-20/BoutinFranciosiniChavaneRuffierPerrinet20face.png)
CNN: Topography
![[Bosking *et al*, 1997]](https://github.com/laurentperrinet/2019-04-03_a_course_on_vision_and_modelization/raw/master/figures/Bosking97Fig4.jpg)
CNN: Topography
]](https://laurentperrinet.github.io/publication/franciosini-21/featured.jpg)
Computational neuroscience of vision
Dynamics of vision
Dynamics of vision
).](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/visual-latency_bg.jpg)
Dynamics of vision
).](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/visual-latency.jpg)
Dynamics of vision
)](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/tsonga.jpg)
Dynamics of vision
)](https://laurentperrinet.github.io/2022-01-12_NeuroCercle/figures/figure-tsonga.jpg)
Dynamics of vision
Dynamics of vision
).](https://github.com/laurentperrinet/Khoei_2017_PLoSCB/raw/master/figures/FLE_DiagonalMarkov.jpg)
Dynamics of vision
Flash-lag effect: MBP (Khoei et al, 2017)
Dynamics of vision
Spiking Neural Networks (SNN)
SNN: Leaky Integrate-and-Fire Neuron
.](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/LIF.gif)
SNN in neurobiology
]](http://i.stack.imgur.com/ixnrz.png)
SNN in neurobiology
]](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/replicating_MainenSejnowski1995.png)
SNN in neurobiology
]](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/Diesmann_et_al_1999.png)
SNN in neurobiology
]](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/haimerl2019.jpg)
SNN: Spiking motifs
.](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/izhikevich.png)
SNN: Spiking motifs
SNN: Spiking motifs
.](https://github.com/SpikeAI/2022_polychronies-review/raw/main/figures/HSD.gif)
SNN in neuromorphic engineering
SNN in neuromorphic engineering
SNN in neuromorphic engineering
SNN in neuromorphic engineering
SNN in neuromorphic engineering
Spiking Neural Networks (SNN)
Artificial neural networks applied to the understanding of biological vision
Artificial neural networks and machine learning applied to the understanding of biological vision
Laurent Perrinet
[2024-05-13] Master M4NC de l’institut NeuroMod, cours Prospective Innovation and Research