- Poster presentation
- Open Access
Decoding of naturalistic textures from spike patterns of neuromorphic artificial mechanoreceptors
BMC Neuroscience volume 16, Article number: P186 (2015)
Significant advances were recently achieved in the bidirectional control of upper limb neuroprostheses , however implementing a realistic tactile feedback on artificial hands is still an open challenge . We target this ambition with a neuromorphic approach. Towards this direction we integrated MEMS tactile sensors with a realistic spatial arrangement on the distal phalanx of artificial fingers  and we converted the sensor readouts into spike trains mimicking the neural firing properties of glabrous skin mechanoreceptors . The neuromorphic approach presents several advantages , among which the most relevant for neuroprosthetics is that a sufficiently realistic tactile feedback is expected to reduce drastically the time the brain needs to adapt to the prosthesis and to each single new task, leading to enhanced quality of life of the subjects.
Since the long term goal is to implement a hardware version of the neuromorphic neurons, we modeled the mechanoreceptors as Izhikevich neurons, a model which at the same time is computationally lean and takes into account the effects of firing rate adaptation that are particularly relevant in mechanoreceptors. Parameters were tuned so to achieve a match with Slowly Adapting (SA) mechanoreceptors dynamics in primates . The output of each tactile sensor was normalized and injected as an excitatory input current into a single neuron model . To reproduce the features of Fast Adapting (FA) mechanoreceptors responsible for edge detection , we injected in a second set of neuron models the smoothed derivative of the pressure sensors outputs.
The fingertip was then repeatedly presented with ten different daily-life textures such as textiles, polymeric tissues, glass or paper. FA spike trains were used to identify onset and offset of contact between fingertip and stimuli, whereas SA spike trains were used to decode the stimulus presented. We applied two decoding procedures: one based on the combination of firing rate and inter-spike interval Fano factor, and the other one based on Victor-Purpura distance . Error rate was close to 20% in the first case and to 5% in the second, reflecting the relevance for decoding of the fine temporal structure of the neuromorphic sensor outputs. Finally, we introduced a normalization in the cost of the Victor-Purpura spike train metrics thanks to which the above level of correct classification was maintained even if sensing conditions varied across trials. These results support a possible future evaluation of the biomimetic fingertip endowed with neuromorphic artificial mechanoreceptors in clinical trials with human subjects.
Raspopovic S, Capogrosso M, Petrini FM, Bonizzato M, Rigosa J, Di Pino G, et al: Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses. Science Translational Medicine. 2014, 6 (222): 222ra219-
Kwok R: Neuroprosthetics: once more, with feeling. Nature. 2013, 497 (7448): 176-177.
Oddo CM, Controzzi M, Beccai L, Cipriani C, Carrozza MC: Roughness Encoding for Discrimination of Surfaces in Artificial Active-Touch. IEEE Transactions on Robotics. 2011, 27 (3): 522-533.
Johansson RS, Flanagan JR: Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat Rev Neurosci. 2009, 10 (5): 345-59.
Service RF: Minds of their own. Science. 2014, 346 (6206): 182-183.
Izhikevich EM: Simple model of spiking neurons. IEEE Transactions on Neural Networks. 2003, 14 (6): 1569-1572.
Spigler G, Oddo CM, Carrozza MC: Soft-neuromorphic artificial touch for applications in neuro-robotics. 2012 4th Ieee Ras & Embs International Conference on Biomedical Robotics and Biomechatronics (Biorob). 2012, 1913-1918.
Victor JD, Purpura KP: Nature and precision of temporal coding in visual cortex: A metric-space analysis. Journal of Neurophysiology. 1996, 76 (2): 1310-1326.
This work was supported by the EU Grant FP7-FET 611687 NEBIAS project, by the EU Grant FP7-NMP 228844 NANOBIOTOUCH project, by the Italian PRIN HandBot project, and by Scuola Superiore Sant'Anna.
About this article
Cite this article
Mazzoni, A., Rongala, U.B. & Oddo, C.M. Decoding of naturalistic textures from spike patterns of neuromorphic artificial mechanoreceptors. BMC Neurosci 16, P186 (2015). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2202-16-S1-P186
- Firing Rate
- Spike Train
- Neuron Model
- Tactile Sensor
- Sensor Output