1

Modelling Complex-cells and topological structure in the visual cortex of mammals using Sparse Predictive Coding

Cells in the primary visual cortex of mammals (V1) have historically been divided into two classes: simple and complex. Simple cells exhibit a rectified linear response to oriented visual stimuli while complex cells show various degrees of invariance …

Understanding natural vision using deep predictive coding

What:: talk @ Séminaire à l’Institut de Recherche sur les Phénomènes Hors Équilibre (IRPHÉ) Who:: Perrinet, Laurent U Where: Marseille (France), see https://laurentperrinet.github.io/talk/2020-09-25-irphe When: 25/09/2020, time: 15:45:00-16:30:00

Visual search as active inference

the mathematical details are described as a talk the 1st International WS on #ActiveInference #IWAI2020 at @ECMLPKDD https://t.co/4s7gHbMxiT and paper "Visual search as active inference" https://t.co/yNCOFHf7FS — laurentperrinet (@laurentperrinet) September 14, 2020 What:: talk @ 1st International Workshop on Active Inference (IWAI*2020)

From the retina to action: Understanding visual processing

Visual areas are essential in transforming the raw luminous signal into a representation which efficiently conveys information about the environment. This process is constrained by various factors such as a wide variety of changes in the …

Modelling Complex-cells and topological structure in the visual cortex of mammals using Sparse Predictive Coding

Cells in the primary visual cortex of mammals (V1) have historically been divided into two classes: simple and complex. Simple cells exhibit a rectified linear response to oriented visual stimuli while complex cells show various degrees of invariance …

Des illusions aux hallucinations visuelles: une porte sur la perception

Les illusions visuelles sont des créations d'artistes, de scientifiques et plus récemment, grâce aux réseaux sociaux, du grand public qui proposent des situations souvent incongrues, dans lesquelles l'eau remonte une cascade, les personnes volent …

Learning dynamics in a neural network model of the primary visual cortex

*Background*: The primary visual cortex (V1) is a key component of the visual system that builds some of the first levels of coherent visual representations from sparse visual inputs. While the study of its dynamics has been the focus of many …

A dynamic model for decoding direction and orientation in macaque primary visual cortex

When objects are in motion, the local orientation of their contours and the direction of motion are two essential components of visual information which are processed in parallel in the early visual areas. Generally, to probe a neuron's response …

Learning where to look: a foveated visuomotor control model

In computer vision, the visual search task consists in extracting a scarce and specific visual information (the target) from a large and crowded visual display. This task is usually implemented by scanning the different possible target identities at …

Should I stay or should I go? Adaption of human observers to the volatility of visual inputs

Animal behavior has to constantly adapt to changes, for instance when unexpectedly switching the state of an environmental context. For an agent interacting with this kind of volatile environment, it is important to respond to such switches …

From the retina to action: Understanding visual processing

Visual areas are essential in transforming the raw luminous signal into a representation which efficiently conveys information about the environment. This process is constrained by various factors such as a wide variety of changes in the …

Sparse Deep Predictive Coding captures contour integration capabilities of the early visual system

Both neurophysiological and psychophysical experiments have pointed out the crucial role of recurrent and feedback connections to process context-dependent information in the early visual cortex. While numerous models have accounted for feedback …

Rencontre avec les collégiens marseillais

Le jeudi 10 janvier 2019, je suis venu échanger au côté de Serge Dentin autour de films traitant du rapport fiction/réel, des illusion visuelles (\" Qu'est ce qu'une image? \"), des rapports d'échelles, de la perception, ... et qui sont projetés lors …

A hierarchical, multi-layer convolutional sparse coding algorithm based on predictive coding

Sparse coding holds the idea that signals can be concisely described as a linear mixture of few components (called atoms) picked from a bigger set of primary kernels (called dictionary). This framework has long been used to model the strategy …

Modelling Complex Cells of Early Visual Cortex using Predictive Coding

Orientation selectivity to synthetic natural patterns in a cortical-like model of the cat primary visual cortex

A key property of the neurons in the primary visual cortex (V1) is their selectivity to oriented stimuli in the visual field. Orientation selectivity allows the segmentation of objects in natural visual scenes, which is the first step in building …

Sparse Deep Predictive Coding to model visual object recognition

If you’re at #sfn2019 and have an interest in #sparse #deep Predictive Coding, checkout @VictorBoutin ‘s poster 403.16 / P20:https://t.co/2VLEsl98oU It shows today + comes with a (timely) preprint https://t.co/FfKi9tjqrN !

Top-down connection in Hierarchical Sparse Coding

The brain has to solve inverse problems to correctly interpret sensory data and infer the set of causes that generated the sensory inputs. When imposing sparse prior and hierarchical structure this problem is called Hierarchical Sparse Coding (HSC). …

La modélisation biomorphique de la perception visuelle

La modélisation biomorphique de la perception visuelle in “La modélisation de la genèse physico-mathématique du vivant” BIOMORPHISME ET CREATION ARTISTIQUE – Session 3 Date 11 Octobre 2018 Atelier Séminaire/workshop organisé dans le cadre du projet Biomorphisme.

Intervention fête de la science 2018

FÊTE DE LA SCIENCE 2018 : Alcazar / MERLAN L’Association Polly Maggoo http://www.pollymaggoo.org/ met en place tout le long de l’année, des actions de culture scientifique et artistique en direction du grand public et des lycées, au cours desquelles l’association programme des films à caractère scientifique.

A low-cost, accessible eye tracking framework

Recording eye movements is a technique that attracts an increasing number of scientists, but also in the general public. Indeed, this allows to quantitatively measure a number of useful dimensions of perception and behavior in general. However, most …

ANEMO: Quantitative tools for the ANalysis of Eye MOvements

see a write-up in “ Humans adapt their anticipatory eye movements to the volatility of visual motion properties” as presented at https://eyemovements.sciencesconf.org/ get the poster code : https://github.com/invibe/ANEMO/

Estimating and anticipating a dynamic probabilistic bias in visual motion direction

Humans are able to accurately track a moving object with a combination of saccades and smooth eye movements. These movements allow us to align and stabilize the object on the fovea, thus enabling high*resolution visual analysis. …

Estimating and anticipating a dynamic probabilistic bias in visual motion direction

Humans are able to accurately track a moving object with a combination of saccades and smooth eye movements. These movements allow us to align and stabilize the object on the fovea, thus enabling high-resolution visual analysis. …

From biological vision to unsupervised hierarchical sparse coding

The formation of connections between neural cells is essentially emerging from an unsupervised learning process. During the development of primary visual cortex (V1) of mammals, for example, one may observe the emergence of cells selective to …

M2APix: a bio-inspired auto-adaptive visual sensor for robust ground height estimation

This paper presents for the first time the embedded stand-alone version of the bio-inspired M2APix (Michaelis-Menten auto-adaptive pixels) sensor as a ventral optic flow sensor to endow glider-type unmanned aerial vehicles with autonomous landing …

On the Origins of Hierarchy in Visual Processing

It is widely assumed that visual processing follows a forward sequence of processing steps along a hierarchy of laminar sub-populations of the neural system. Taking the example of the early visual system of mammals, most models are consequently …

Selectivity to oriented patterns of different precisions

The selectivity of the visual system to oriented patterns is very well documented in a wide range of species, especially in mammals. In particular, neurons of the primary visual cortex are anatomically grouped by their preference to a given oriented …

Speed uncertainty and motion perception with naturalistic random textures

It is still not fully understood how visual system integrates motion energy across different spatial and temporal frequencies to build a coherent percept of the global motion under the complex, noisy naturalistic conditions. We addressed this …

Unsupervised Hierarchical Sparse Coding algorithm inspired by Biological Vision

The brain has to solve inverse problems to correctly interpret sensory data and infer the set of causes that generated the sensory inputs. Such a problem is typically ill-posed, and thus requires constraint the narrow down the number of solutions. …

Participation au jury

FESTIVAL INTERFÉRENCES​ Cinéma Documentaire et Débat Public Le collectif Scènes Publiques composé de citoyens, chercheurs et cinéastes, organise la deuxième édition du Festival Interférences du 8 au 18 novembre 2017 à Lyon.

Controlling an aerial robot with human gestures using bio-inspired algorithm

Improve performances of existing recognition computer vision algorithms with biological concepts. The gain are expected in the following: Recognition latency and accuracy (faster and better), less data needed to train algorithms and of decreased …

Dynamic modulation of volatility by reward contingencies: effects on anticipatory smooth eye movement

Efficient learning of sparse image representations using homeostatic regulation

One core advantage of sparse representations is the efficient coding of complex signals using compact codes. For instance, it allows for the representation of any image as a combination of few elements drawn from a large dictionary of basis …

Efficient learning of sparse image representations using homeostatic regulation

One core advantage of sparse representations is the efficient coding of complex signals using compact codes. For instance, it allows for the representation of any image as a combination of few elements drawn from a large dictionary of basis …

Estimating and anticipating a dynamic probabilistic bias in visual motion direction

see a write-up in “ Humans adapt their anticipatory eye movements to the volatility of visual motion properties”

Expériences autour de la perception de la forme en art et science

La vision utilise un faisceau d'informations de différentes qualités pour atteindre une perception unifiée du monde environnant. Nous avons utilisé lors de plusieurs projets art-science (voir https://github.com/NaturalPatterns) des installations …

How the dynamics of human smooth pursuit is influenced by speed uncertainty

Voluntary tracking the moving clouds : Effects of speed variability on human smooth pursuit

The properties of motion processing for driving smooth eye movements have bee investigated using simple, artificial stimuli such as gratings, small dots or random dot patterns. Motion processing in the context of complex, natural images is less …

Participation au jury et entretien avec Clara Delmon

RENCONTRES INTERNATIONALES SCIENCES & CINÉMAS cinéma les Variétés L’Association Polly Maggoo http://www.pollymaggoo.org/ programme la 10e édition des RENCONTRES INTERNATIONALES SCIENCES & CINÉMAS (RISC) à Marseille, au cours desquelles l’association programme des films à caractère scientifique.

Biologically-inspired characterization of sparseness in natural images

Natural images follow statistics inherited by the structure of our physical (visual) environment. In particular, a prominent facet of this structure is that images can be described by a relatively sparse number of features. We designed a sparse …

Operant reinforcement versus reward expectancy: effects on anticipatory eye movements

Les illusions visuelles, un révélateur du fonctionnement de notre cerveau

Les illusions visuelles sont des créations d'artistes, de scientifiques et plus récemment, grâce aux réseaux sociaux, du grand public qui proposent des situations souvent incongrues, dans lesquelles l'eau remonte une cascade, les personnes volent …

Les illusions visuelles, un révélateur du fonctionnement de notre cerveau

Ce lundi 25 avril de 9h à 12h, je suis venu échanger au côté de Serge Dentin autour de films traitant du rapport fiction/réel, des illusion visuelles (\" Qu'est ce qu'une image? \"), des rapports d'échelles, de la perception, ... et qui sont projetés …

A dynamic model for decoding direction and orientation in macaque primary visual cortex

Natural scenes generally contain objects in motion. The local orientation of their contours and the direction of motion are two essential components of visual information which are processed in parallel in the early visual areas. Focusing on the …

A dynamic model for decoding direction and orientation in macaque primary visual cortex

Natural scenes generally contain objects in motion. The local orientation of their contours and the direction of motion are two essential components of visual information which are processed in parallel in the early visual areas. Focusing on the …

Compensation of oculomotor delays in the visual system's network

We consider the problem of sensorimotor delays in the optimal control of movement under uncertainty. Specifically, we consider axonal conduction delays in the visuo-oculomotor loop and their implications for active inference. Active inference uses a …

Effects of motion predictability on anticipatory and visually-guided eye movements: a common prior for sensory processing and motor control?

Modeling the effect of dynamic contingencies on anticipatory eye movements

Voluntary tracking the moving clouds : Effects of speed variability on human smooth pursuit

Voluntary tracking the moving clouds : Effects of speed variability on human smooth pursuit

Voluntary tracking the moving clouds : Effects of speed variability on human smooth pursuit

Sparse Coding Of Natural Images Using A Prior On Edge Co-Occurences

Oriented edges in images of natural scenes tend to be aligned in co-linear or co-circular arrangements, with lines and smooth curves more common than other possible arrangements of edges (the good continuation law of Gestalt psychology). The visual …

A Mathematical Account of Dynamic Texture Synthesis for Probing Visual Perception

Anticipating a moving target: role of vision and reinforcement

Anticipatory smooth eye movements and reinforcement

When an object is moving in the visual field, we are able to accurately track it with a combination of saccades and smooth eye movements. These movements allow us to align and stabilize the object on the fovea, thus enabling visual analysis with high …

Anticipatory smooth eye movements as operant behavior

Eye tracking a self-moved target with complex hand-target dynamics

On overdispersion in neuronal evoked activity

The repeated presentation of an identical visual stimulus in the receptive field of a neuron may evoke different spiking patterns at each trial. Probabilistic methods are essential to understand its functional role within the neural activity. In that …

Spatiotemporal tuning of retinal ganglion cells dependent on the context of signal presentation

Beyond simply faster and slower: exploring paradoxes in speed perception

Estimating object speed in visual scenes is a critical part of perception. While various aspects of speed computation including discrimination thresholds, neural mechanisms and spatial integration mechanisms have been studied, there remain areas to …

Edge co-occurrences are sufficient to categorize natural versus animal images

Analysis and interpretation of a visual scene to extract its category, such as whether it contains an animal, is typically assumed to involve higher-level associative brain areas. Previous proposals have been based on a series of processing steps …

Motion-based prediction model for flash lag effect

The flash lag effect (FLE) is a well known visual illusion that reveals the perceptual difference in position coding of moving and stationary flashed objects. It has been reproduced experimentally in retina and V1 along with some relevant evidences …

The characteristics of microsaccadic eye movements varied with the change of strategy in a match-to-sample task

Under natural viewing conditions, large eye movements are interspace by small eye movements (microsaccade). Recent works have shown that these two kinds of eye movements are generate by the same oculomotor mechanisms (Goffart et al., 2012) and are …

A Simple Model of Orientation Encoding Accounting For Multivariate Neural Noise

see a follow-up in this publication

A Simple Model of Orientation Encoding Accounting For Multivariate Neural Noise

see a follow-up in this publication

Dynamic Textures For Probing Motion Perception

This work extends the MotionClouds dynamic texture model testing aspects of its parametrization with an application in psychophysics.

On the nature of anticipatory eye movements and the factors affecting them

Relationship between natural image statistics and lateral connectivity in the primary visual cortex

Signature of an anticipatory response in area V1 as modeled by a probabilistic model and a spiking neural network

As it is confronted to inherent neural delays, how does the visual system create a coherent representation of a rapidly changing environment? In this paper, we investigate the role of motion-based prediction in estimating motion trajectories …

Active inference, eye movements and oculomotor delays

We consider the problem of sensorimotor delays in the optimal control of movement under uncertainty. Specifically, we consider axonal conduction delays in the visuo-oculomotor loop and their implications for active inference. Active inference uses a …

Active inference, eye movements and oculomotor delays

We consider the problem of sensorimotor delays in the optimal control of movement under uncertainty. Specifically, we consider axonal conduction delays in the visuo-oculomotor loop and their implications for active inference. Active inference uses a …

How and why do image frequency properties influence perceived speed?

Humans are able to interact successfully with moving objects in our dynamic world and the visual system effi ciently performs the motion computation that makes this possible. Object speed and direction are estimated following the integration of …

Measuring speed of moving textures: Different pooling of motion information for human ocular following and perception

The visual system does not process information instantaneously, but rather integrates over time. Integration occurs both for stationary objects and moving objects, with very similar time constants (Burr, 1981). We measured, as a function of exposure …

Motion-based prediction and development of the response to an 'on the way' stimulus

Based on Perrinet et al, 2012 See a followup in Khoei et al, 2013

Active inference, smooth pursuit and oculomotor delays

We consider the problem of sensorimotor delays in the optimal control of movement under uncertainty. Specifically, we consider axonal conduction delays in the visuo-oculomotor loop and their implications for active inference. Active inference uses a …

Effect of image statistics on fixational eye movements

Under natural viewing conditions, small movements of the eyes prevent the maintenance of a steady direction of gaze. It is unclear how the spatiotemporal content of the fixated scene has an impact on the properties of miniatures, fixational eye …

Measuring speed of moving textures: Different pooling of motion information for human ocular following and perception.

To measure speed and direction of moving objects, the cortical motion system pools information across different spatiotemporal channels. One yet unsolved question is to understand how the brain pools this information and whether this pooling is …

Motion-based prediction is sufficient to solve the aperture problem

In low-level sensory systems, it is still unclear how the noisy information collected locally by neurons may give rise to a coherent global percept. This is well demonstrated for the detection of motion in the aperture problem: as luminance of an …

Pattern discrimination for moving random textures: Richer stimuli are more difficult to recognize

In order to analyze the characteristics of a rich dynamic visual environment, the visual system must integrate information collected at different scales through different spatiotemporal frequency channels. Still, it remains unclear how reliable …

Role of motion-based prediction in motion extrapolation

Based on Perrinet et al, 2012 See a followup in Khoei et al, 2013

Pattern discrimination for moving random textures: Richer stimuli are more difficult to recognize

In order to analyze the characteristics of a rich dynamic visual environment, the visual system must integrate information collected at different scales through different spatiotemporal frequency channels. Still, it remains unclear how reliable …

Edge statistics in natural images versus laboratory animal environments: implications for understanding lateral connectivity in V1

Oriented edges in images of natural scenes tend to be aligned in collinear or co-circular arrangements, with lines and smooth curves more common than other possible arrangements of edges (Geisler et al., Vis Res 41:711-24, 2001). The visual system …

Role of motion inertia in dynamic motion integration for smooth pursuit

Based on Perrinet et al, 2012 See a followup in Khoei et al, 2013

Diffraction monochromatique, spectre audiographique

En perception, les neurones « parlent » tous en même temps par de brèves impulsions électrochimiques, générant un mélange de signaux, un bruit. Pourtant c'est par eux que nous pensons, voyons, sentons. Les ordinateurs sont différents, plus rapides. …

A recurrent Bayesian model of dynamic motion integration for smooth pursuit

Different pooling of motion information for perceptual speed discrimination and behavioral speed estimation

Dynamical emergence of a neural solution for motion integration

Based on Perrinet et al, 2012 See a followup in Khoei et al, 2013

Dynamical emergence of a neural solution for motion integration

Phase space analysis of networks based on biologically realistic parameters

We study cortical network dynamics for a more realistic network model. It represents, in terms of spatial scale, a large piece of cortex allowing for long-range connections, resulting in a rather sparse connectivity. We use two different types of …

Probabilistic models of the low-level visual system: the role of prediction in detecting motion

Sensory informations such as visual images are inherently variable. We use probabilistic models to describe how the low-level visual system could describe superposed and ambiguous information. This allows to describe the interactions of neighboring …

Peut-on parler d'intelligence mécanique?

Nous parlerons de cette partie \"mécanique\" du cerveau animal ou humain qui permet de percevoir les mouvements et de ... survivre au sein de l'environnement. On verra, par exemple, que notre cerveau peut-être plus rapide que nous, qu'il y a des …

Decoding center-surround interactions in population of neurons for the ocular following response

Short presentation of a large moving pattern elicits an Ocular Following Response (OFR) that exhibits many of the properties attributed to low-level motion processing such as spatial and temporal integration, contrast gain control and divisive …

Dynamical state spaces of cortical networks representing various horizontal connectivities

Most studies of cor tical network dynamics are either based on purely random wiring or neighborhood couplings, e.g., [Kumar, Schrader, Aer tsen, Rotter, 2008, Neural Computation 20, 1--43]. Neuronal connections in the cor tex, however, show a complex …

Dynamics of cortical networks including long-range patchy connections

Most studies of cortical network dynamics are either based on purely random wiring or neighborhood couplings [1], focussing on a rather local scale. Neuronal connections in the cortex, however, show a more complex spatial pattern composed of local …

Functional consequences of correlated excitation and inhibition on single neuron integration and signal propagation through synfire chains

Neurons receive a large number of excitatory and inhibitory synaptic inputs whose temporal interplay determines their spiking behavior. On average, excitation (Gexc) and inhibition (Ginh) balance each other, such that spikes are elicited by …

Inferring monkey ocular following responses from V1 population dynamics using a probabilistic model of motion integration

Short presentation of a large moving pattern elicits an ocular following response that exhibits many of the properties attributed to low-level motion processing such as spatial and temporal integration, contrast gain control and divisive interaction …

NeuralEnsemble: Towards a meta-environment for network modeling and data analysis

NeuralEnsemble (http://neuralensemble.org) is a multilateral effort to coordinate and organise neuroscience software development efforts based around the Python programming language into a larger, meta-simulator software system. To this end, …

Analyzing cortical network dynamics with respect to different connectivity assumptions

Functional properties of feed-forward inhibition

see this subsequent paper in the Journal of Computational Neuroscience