Event-based vision

Adrien Fois & Laurent Perrinet

[2023-12-14] Journées sur l’apprentissage frugal (JRAF)

logos

adrien.fois@univ-amu.fr laurent.perrinet@univ-amu.fr

Sensing light

Representing spatio-temporal luminous information

Representing spatio-temporal luminous information

Frame-Based Camera: Temporal discretization

Frame-Based Camera: Aliasing

[[Gregor Lenz, 2020](https://lenzgregor.com/posts/event-cameras/)]
[Gregor Lenz, 2020]

Frame-Based Camera: Wagon-Wheel Illusion

[[Sam Brinson, 2020](https://www.sambrinson.com/nature-of-perception/)]
[Sam Brinson, 2020]

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

Event-Based Camera

SensorRangeFramerateResolutionPower
Human eye60 (?) dB300 (?) fps100 (?) Mpx10 mW
DSLR44.6 dB120 fps2–20 Mpx30 W
Ultra-high speed64 dB10^4 fps0.3–4 Mpx300 W
Event-based120 dB10^6 fps0.1–2 Mpx30 mW

Event-Based Camera

Event-Based Camera

Event-Based Computer vision

Always-on Object Recognition: DVS gesture

Always-on Object Recognition

[[Grimaldi, Boutin, Sio-Ieng, Benosman & LP, 2023](https://laurentperrinet.github.io/publication/grimaldi-24/)]
[Grimaldi, Boutin, Sio-Ieng, Benosman & LP, 2023]

Always-on Object Gesture Recognition

[[Grimaldi, Boutin, Sio-Ieng, Benosman & LP, 2023](https://laurentperrinet.github.io/publication/grimaldi-24/)]
[Grimaldi, Boutin, Sio-Ieng, Benosman & LP, 2023]

Always-on Object Gesture Recognition

[[Grimaldi, Boutin, Sio-Ieng, Benosman & LP, 2023](https://laurentperrinet.github.io/publication/grimaldi-24/)]
[Grimaldi, Boutin, Sio-Ieng, Benosman & LP, 2023]

Event-based vision

Adrien Fois & Laurent Perrinet

[2023-12-14] Journées sur l’apprentissage frugal (JRAF)

logos

adrien.fois@univ-amu.fr laurent.perrinet@univ-amu.fr

Spiking Neural Networks

[[Tonic manual](https://tonic.readthedocs.io/en/latest/_images/neuron-models.png)]
[Tonic manual]

Spiking Neural Networks: LIF Neuron

[Grimaldi *et al*, 2023, [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/)]
[Grimaldi et al, 2023, Precise Spiking Motifs]

Spiking Neural Networks: neuromorphic hardware

Loihi 2
Loihi 2

Spiking Neural Networks in neurobiology

[[Mainen & Sejnowski, 1995](https://github.com/SpikeAI/2022_polychronies-review/blob/main/src/Figure_2_MainenSejnowski1995.ipynb)]
[Mainen & Sejnowski, 1995]

Spiking Neural Networks in neurobiology

[[Diesmann et al. 1999](https://github.com/SpikeAI/2022_polychronies-review/blob/main/src/Figure_3_Diesmann_et_al_1999.py)]
[Diesmann et al. 1999]

Spiking Neural Networks in neurobiology

[[Haimerl et al, 2019](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/)]
[Haimerl et al, 2019]

Spiking Neural Networks: Spiking motifs

Spiking Neural Networks: Spiking motifs

[Grimaldi *et al*, 2023, [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/)]
[Grimaldi et al, 2023, Precise Spiking Motifs]

Spiking Neural Networks: Spiking motifs

Review on [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/).
Review on Precise Spiking Motifs.

Spiking Neural Networks: Spiking motifs

Review on [Precise Spiking Motifs](https://laurentperrinet.github.io/publication/grimaldi-22-polychronies/).
Review on Precise Spiking Motifs.

Spiking Neural Networks: HD-SNN

Spiking Neural Networks: HD-SNN

[Grimaldi & LP (2023) Biol Cybernetics](https://laurentperrinet.github.io/publication/grimaldi-23-bc/)
Grimaldi & LP (2023) Biol Cybernetics

Spiking Neural Networks: HD-SNN

[Grimaldi & LP (2023) Biol Cybernetics](https://laurentperrinet.github.io/publication/grimaldi-23-bc/)
Grimaldi & LP (2023) Biol Cybernetics

Spiking Neural Networks: HD-SNN

[Grimaldi & LP (2023) Biol Cybernetics](https://laurentperrinet.github.io/publication/grimaldi-23-bc/)
Grimaldi & LP (2023) Biol Cybernetics

Spiking Neural Networks: HD-SNN

[Grimaldi & LP (2023) Biol Cybernetics](https://laurentperrinet.github.io/publication/grimaldi-23-bc/)
Grimaldi & LP (2023) Biol Cybernetics

Spiking Neural Networks: HD-SNN

[Grimaldi & LP (2023) Biol Cybernetics](https://laurentperrinet.github.io/publication/grimaldi-23-bc/)
Grimaldi & LP (2023) Biol Cybernetics