ANR HorizontalV1 (2017/2021)
 Description on the official website of the ANR
The HorizontalV1 project aims at understanding the emergence of sensory predictions linking local shape attributes (orientation, contour) to global indices of movement (direction, speed, trajectory) at the earliest stage of cortical processing (primary visual cortex, i.e. V1). We will study how the longdistance “horizontal” connectivity, intrinsic to V1 and the feedback from higher cortical areas contribute to a dynamic processing of localtoglobal features as a function of the context (eg displacement along a trajectory; during reafference change induced by eyemovements…). We will search to characterize the dynamic processes based on lateral propagation intraV1, through which spatiotemporal inferences (continuous movement or apparent motion sequences) facilitating spatial (“fillingin”) or positional (“flashlag”) future expected responses may be generated. The project will use a variety of animations of local oriented stimuli forming, according to their spatial and temporal coherence, predictable global patterns, apparent motion sequences and/or continuous trajectories. We will measure the cortical dynamics at two scales of neuronal integration, from micro (intracellular, SUA) to mesoscopic levels (multielectrode arrays (MEA) and voltage sensitive dye imaging (VSDI)) in the anesthetized (cat, marmoset) and awake fixating animal (macaca mulata). In a second step, we will combine these multiscale observations to constrain a structurofunctional model of lowlevel perception, integrating the micromeso constraints. Two laboratories will participate in synergy to the project: UNICGif (Dir. Yves Frégnac, DRCE2 CNRS, coordinator) and INTMarseille (NeOpTo Team Dir. Frédéric Chavane, DR2 CNRS).
WP3  Design of novel visual paradigms, probabilistic model of V1 and datadriven simulations  co lead UNICINT.
Objectives : This WP will have two primary goals. The first one is theoretically driven, and for sake of simplicity will ignore the dynamic features of neural integration (as expected from a statistical model of image analysis). Binding the different features of visual objects at the local scale (contours) as well as a more global level involves understanding the statistical regularities of the sensory inflow. In particular, titrating the predictions that can be done at the statistical level can be seen as a first pass to better search for critical parameters constraining the network behaviour. From these, we will build probabilistic predictive models optimized for edge cooccurrence classification and generate novel visual statistics 1) which obey rules imposed by the functional horizontal connectivity anisotropies, such as co circularity, and 2) which facilitate binding in the orientation domain, such as logpolar planforms. These statistics generated in the first half of the grant will be implemented and tested experimentally in the second half of the grant. The second one is more datadriven (as well as phenomenological for feedback from higher cortical areas, since it will not be explored in the grant). Since model fitting will depend on close interactions with WP1 and WP2 measurements, it will be done in the second half of the grant.
WP3Task 1: Theoretically oriented workplan – Lead INT (Laurent Perrinet)

WP3Task 1.1  theory : we will exploit our current expertise in integrating these statistics in the form of probabilistic models to make predictions both at the physiological and modelling levels. First, we will take advantage of our previous work on the quantification of the association field in different classes of natural images (Perrinet & Bednar, 2015). Using an existing library (https://github.com/bicv/SparseEdges), we will use the sparse representation of static natural images to compute histograms of edge cooccurrences. Using an existing algorithm for unsupervised learning (https://github.com/bicv/SparseHebbianLearning), we will learn the different independent components of edge cooccurrences. Such an algorithm fits well a traditional deeplearning convolutional neural network, but, in addition, will include constraints imposed by intralayer horizontal connectivity. We expect that relevant features will be colinear or cocircular pairs of edges, but also Tjunctions or endstopping features.

WP3Task 1.2  image/film synthesis : We have previously found that random synthetic textures, coined “Motion Clouds”, can be used to quantify V1 implication in visual motion perception (Leon et al, 2012; Simoncini et al, 2012). Recently, the INT and UNIC, partners proved mathematically that these stimuli were optimal with respect to some common geometrical transformations, such as translation, zoom or rotations (Vacher et al, 2015). A main characteristic of these textures is to be generated with a maximally entropic arrangement of elementary textures (socalled textons).
** Informed by the generative model of edge cooccurrences studied in subtask 1, we will be able to extend the family of motion cloud stimuli (Leon et al, 2012; Simoncini et al, 2012) to include joint dependencies between different elements in position or orientation. An exact solution to this problem is hard to achieve as it involves a combinatorial search of all possible combinations of pairs of edges. However, numerous variational approaches are possible and fit well with our probabilistic framework. We will use the convolutional neural network described above but using a backpropagating stream to generate different images. Such a representation will then be optimized using an unsupervised learning method. This is similar to the process used in Generative Adversarial Networks in deeplearning architectures (Radford et al, Archives). ** Finally, the regularities observed in static images will be extended to dynamical scenes by observing that a cooccurrence can be implemented by simple geometrical operations as they are operated in time. For instance a cocircularity is easily described as the set of smooth rototranslational transformations of an edge in time using the group of Galilean transformations (Sarti and Citti, 2006). This theory calls for a first prediction to understand the set of whole possible spatiotemporal cooccurrences of edges as geodesics in the lifted space of all possible trajectories. We predict that such decomposition should allow us to better understand the different classes of features that emerged in the first task.
 WP3Task 1.3  Feedback of theory on experimentation : An essential aspect of this work would be to apply these stimuli in neurophysiological experiments and in the modelling. In particular, the ability to select different types of dependencies from the different classes learned above (for instance, cocircularities of a certain curvature range) will make it possible to evaluate the relative contribution of different components of the contextual information. This justifies the fact that the WP3 postdoctoral fellow should have the mobility (between INT and UNIC) and multidisciplinar profile (theoretical and experimental) to perform this task.
 WP3Task 1.4  Generic modelling : These various subtasks will allow us to determine the hierarchy of critical features relevant to describe the full statistics of the space of spatiotemporal edge cooccurrences. Indeed, in static images, we will be able to find independent component in the histograms of edge cooccurrences between metric aspect (distance or scale between edge) from configurational aspects (difference of angle or cocircularity angle).
Similarly, we expect to see that the different independent features should decompose at various scales both in space and in time. For instance, we expect configurational aspects to be more local while aspects related to a motion (Perrinet and Masson, 2012; Khoei et al, 2016) or global shape (form) should be more global. This translates into a probabilistic hierarchical model that would combine dependencies from different cues. In particular, through the emergence of differential pathways for form and motion. These quantitative predictions should finally be confronted at the modelling and neurophysiological levels.
WP3Task 2 : Datadriven comprehensive model of V1 – Colead UNIC and INT
The second task is more datadriven (as well as phenomenological for the feedback circuit part, since largely unknown). Since simulations will depend on close interactions with WP1 and WP2 measurements, it will be developed by the WP3PostDoc in the second half of the grant. It will benefit from existing structurofunctional models addressing separately two distinct levels of neural integration, microscopic (conductancebased in Kremkow et al, 2016; Antolik et al, submitted, Chariker et al, 2016) and mesoscopic (VSDlike mean field in Rankin and Chavane, 2017). Efforts will be made to merge these models to fit  in a unified multiscale biologically realistic model  the cellular and VSD data targeting critically horizontal propagation. The parameterization should be flexible enough to produce a generic cortical architecture accounting possibly for speciesspecificity (Antolik for cat; Chaliker for monkey)
Acknowledgement
This work was supported by ANR project “HorizontalV1” N° ANR17CE370006.