Skip to main content
  • Poster Presentation
  • Open access
  • Published:

The first five percent of neural contrast spikes from a visual scene robustly computes the gravity vector

Current approaches to determine upright orientation and rotation rely on inertial accelerometers combined with gravity-measuring sensors. Biological posture control uses three senses. The most well known sense is the inner ear, which senses angular rotation and linear velocity. Proprioception is the sensing of body posture and center of mass with respect to gravity. A third sense of balance and orientation information comes from the optical system. This presentation presents a biologically-inspired algorithm for determining absolute orientation and rotation using computer image processing. The approach relies on the statistical property of man-made or cultural environments to exhibit predominately more horizontal and vertical edges than oblique edges [1]. That is, vertical edges of cultural objects tend to mirror the gravity vector. A biologically-inspired Gaussian on-/off-center contrast model [2] is used to extract edges, the first N% of luminance contrast-based neural spikes (top N% of the brightest edge pixels) in various scales form a basis set for image segmentation, multiple regions of interest are summed to accumulate image statistics, and a line template is correlated to determine a probabilistic orientation distribution with respect to a body-centered reference frame. The algorithm was tested against 600 real-world, cultural images and achieved 96% correct upright orientation +/-0.5o with a mean signal to noise ratio (SNR) of 10.75dB and 2.93dB standard deviation (see Figure 1). A sensitivity analysis was performed to determine the temporal percent of neural contrast spikes required for robust performance. It was found that as few as the first 5% of neural contrast spikes from a visual scene robustly (94%) computes the gravity vector, without prior knowledge of or training on the environment. Further, it was found that the quality of the accumulated image correlates to the probability of organic or natural scenes (P=0.0 for a point cloud) and to man-made or cultural scenes (P=1.0 for strong horizontal and vertical lines).

Figure 1
figure 1

Sensitivity analysis wherein the horizontal axis is the first N% of accumulated luminance contrast-based neural spikes varying from 0.01% to 15%, for a constant-scale Gaussian on-/off-center contrast model. Note the images to the right shows the algorithm response is a point-cloud for organic scenes (bottom right) and strong vertical and horizontal lines for man-made scenes (top right). The algorithm was tested against 312 real-world, cultural images. The vertical axis plots the rotation angle percent correct for an upright orientation +/-0.5o. Three insert plots show the SNR over the run set for the temporal first 0.1%, 5%, and 12% of neural contrast spikes.

References

  1. Torralba A, Oliva A: Statistics of natural image categories. Comput. Neural Syst. 2003, 14: 391-412. 10.1088/0954-898X/14/3/302.

    Article  Google Scholar 

  2. VanRullen R, Thorpe S: Surfing a spike wave down the ventral stream. Vision Res. 2002, 42: 2593-2615. 10.1016/S0042-6989(02)00298-5.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John R Goulding.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Goulding, J.R. The first five percent of neural contrast spikes from a visual scene robustly computes the gravity vector. BMC Neurosci 11 (Suppl 1), P179 (2010). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2202-11-S1-P179

Download citation

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2202-11-S1-P179

Keywords