Artificial neural networks and machine learning applied to the understanding of biological vision

Laurent Perrinet

[2025-05-26] Master M4NC de l’institut NeuroMod, cours Prospective Innovation and Research

$logo$

Contact me @ laurent.perrinet@univ-amu.fr

Principles of Vision

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

What is the function of vision?

An Unexpected Visitor (Ilya Repin, 1884)
seeing= interacting with the visual world
social animals: looking at emotions

What is the function of vision?

[An Unexpected Visitor (Yarbus, 1965)](https://www.cabinetmagazine.org/issues/30/archibald.php) — An Unexpected Visitor (Yarbus, 1965)

active: the eye is always moving
https://fr.wikipedia.org/wiki/Alfred_Iarbous
consistency of eye traces

What is the function of vision?

An Unexpected Visitor - Age? (Yarbus, 1965)
social animals: looking at emotions

What is the function of vision?

[An Unexpected Visitor - *How long?* (Yarbus, 1965)](https://www.cabinetmagazine.org/issues/30/archibald.php) — An Unexpected Visitor - How long? (Yarbus, 1965)

Visual illusions

[Rotating Snakes *Akiyoshi KITAOKA*](http://www.ritsumei.ac.jp/~akitaoka/index-e.html) — Rotating Snakes Akiyoshi KITAOKA

Visual illusions

Ilusions of brightness or lightness Akiyoshi KITAOKA

Visual illusions

[Hering illusion](https://en.wikipedia.org/wiki/Hering_illusion) — Hering illusion

Visual illusions

[Hering illusion](https://en.wikipedia.org/wiki/Hering_illusion) — Hering illusion

Visual illusions

[Rotating Snakes *Akiyoshi KITAOKA*](http://www.ritsumei.ac.jp/~akitaoka/index-e.html) — Rotating Snakes Akiyoshi KITAOKA

Visual illusions : Pareidolia

[Cydonia Mensae (1976) *Viking Orbiter image*](https://en.wikipedia.org/wiki/Cydonia_(Mars)) — Cydonia Mensae (1976) Viking Orbiter image

Visual illusions : Pareidolia

[Cydonia Mensae (2007) *Mars Global Surveyor*](https://en.wikipedia.org/wiki/Cydonia_(Mars)) — Cydonia Mensae (2007) Mars Global Surveyor

Visual illusions : Pareidolia

[Cydonia Mensae (2007) *Mars Global Surveyor*](https://en.wikipedia.org/wiki/Cydonia_(Mars)) — Cydonia Mensae (2007) Mars Global Surveyor

Principles of vision?

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

Computational neuroscience of vision

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

Computational neuroscience of vision

[[Sejnowski, Koch & Churchland (1998)](http://www.hms.harvard.edu/bss/neuro/bornlab/nb204/papers/sejnowski-koch-churchland-science1988.pdf)] — [Sejnowski, Koch & Churchland (1998)]

Anatomy of the Human Visual system

Human Visual system : the HMAX model

[Serre and Poggio, 2007]

Primary visual cortex

[Hubel & Wiesel, 1962]

Primary visual cortex

[Hubel & Wiesel, 1962]

Hybrid IA models

Using goal-driven deep learning models to understand sensory cortex [Yamins & DiCarlo, 2016]

a single neuron is selective to some visual features…

Convolutional Neural Nets (CNN)

[[Boutin *et al*, 2021](https://laurentperrinet.github.io/publication/boutin-franciosini-chavane-ruffier-perrinet-20/)] — [Boutin et al, 2021]

Convolutional Neural Nets (CNN)

[[Jérémie & LP, 2023](https://laurentperrinet.github.io/publication/jeremie-23-ultra-fast-cat/)] — [Jérémie & LP, 2023]

CNN: challenges

[[Boutin *et al*, 2021](https://laurentperrinet.github.io/publication/boutin-franciosini-chavane-ruffier-perrinet-20/)] — [Boutin et al, 2021]

CNN: Predictive processing

[[Boutin *et al*, 2021](https://laurentperrinet.github.io/publication/boutin-franciosini-chavane-ruffier-perrinet-20/)] — [Boutin et al, 2021]

modifications= adding sparse coding + feedback

CNN: Predictive processing

[[Boutin *et al*, 2021](https://laurentperrinet.github.io/publication/boutin-franciosini-chavane-ruffier-perrinet-20/)] — [Boutin et al, 2021]

CNN: Topography

[Bosking *et al*, 1997] — [Bosking et al, 1997]

CNN: Topography

[[Boutin *et al*, 2022](https://laurentperrinet.github.io/publication/franciosini-21/)] — [Boutin et al, 2022]

Computational neuroscience of vision

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

Spiking Neural Networks (SNN)

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

SNN: Leaky Integrate-and-Fire Neuron

Review on [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/). — Review on Precise Spiking Motifs.

SNN in neurobiology

[[Mainen & Sejnowski, 1995](https://github.com/SpikeAI/2022_polychronies-review/blob/main/src/Figure_2_MainenSejnowski1995.ipynb)] — [Mainen & Sejnowski, 1995]

SNN in neurobiology

[[Mainen & Sejnowski, 1995](https://github.com/SpikeAI/2022_polychronies-review/blob/main/src/Figure_2_MainenSejnowski1995.ipynb)] — [Mainen & Sejnowski, 1995]

SNN in neurobiology

[[Diesmann et al. 1999](https://github.com/SpikeAI/2022_polychronies-review/blob/main/src/Figure_3_Diesmann_et_al_1999.py)] — [Diesmann et al. 1999]

SNN in neurobiology

[[Haimerl et al, 2019](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/)] — [Haimerl et al, 2019]

SNN: Spiking motifs

Review on [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/). — Review on Precise Spiking Motifs.

SNN: Spiking motifs

Review on [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/). — Review on Precise Spiking Motifs.

SNN: Spiking motifs

Review on [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/). — Review on Precise Spiking Motifs.

2 MINUTE
A nice HSD neuron

SNN in neuromorphic engineering

From frame-based to event-based cameras.

2 MINUTE
event-based cameras

SNN in neuromorphic engineering

The HD-SNN neural network.

2 MINUTE
For instance, we show how precise spike times may be used to detect the direction of motion from such a stream of events in an ultrafast fashion.

SNN in neuromorphic engineering

2 MINUTE
A nice HSD neuron
For instance, we show how precise spike times may be used to detect the direction of motion from such a stream of events in an ultrafast fashion.

SNN in neuromorphic engineering

The HD-SNN neural network.

2 MINUTE
nice kernels

SNN in neuromorphic engineering

The HD-SNN neural network.

Spiking Neural Networks (SNN)

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

# Artificial neural networks applied to the understanding of biological vision

[[Marr, 1982](https://outde.xyz/2020-01-12/overappreciated-arguments-marrs-three-levels.html)] — [Marr, 1982]

Artificial neural networks and machine learning applied to the understanding of biological vision

Laurent Perrinet

[2025-05-26] Master M4NC de l’institut NeuroMod, cours Prospective Innovation and Research

$logo$

Contact me @ laurent.perrinet@univ-amu.fr