Tactile sensory coding and learning with bio-inspired optoelectronic spiking afferent nerves

Hongwei Tan (Corresponding Author), Quanzheng Tao, Ishan Pande, Sayani Majumdar, Fu Liu, Yifan Zhou, Per O.Å. Persson, Johanna Rosen, Sebastiaan van Dijken (Corresponding Author)

Research output: Contribution to journalArticleScientificpeer-review

2 Citations (Scopus)

Abstract

The integration and cooperation of mechanoreceptors, neurons and synapses in somatosensory systems enable humans to efficiently sense and process tactile information. Inspired by biological somatosensory systems, we report an optoelectronic spiking afferent nerve with neural coding, perceptual learning and memorizing capabilities to mimic tactile sensing and processing. Our system senses pressure by MXene-based sensors, converts pressure information to light pulses by coupling light-emitting diodes to analog-to-digital circuits, then integrates light pulses using a synaptic photomemristor. With neural coding, our spiking nerve is capable of not only detecting simultaneous pressure inputs, but also recognizing Morse code, braille, and object movement. Furthermore, with dimensionality-reduced feature extraction and learning, our system can recognize and memorize handwritten alphabets and words, providing a promising approach towards e-skin, neurorobotics and human-machine interaction technologies.

Original languageEnglish
Article number1369
JournalNature Communications
Volume11
Issue number1
DOIs
Publication statusPublished - 13 Mar 2020
MoE publication typeA1 Journal article-refereed

Fingerprint Dive into the research topics of 'Tactile sensory coding and learning with bio-inspired optoelectronic spiking afferent nerves'. Together they form a unique fingerprint.

  • Cite this

    Tan, H., Tao, Q., Pande, I., Majumdar, S., Liu, F., Zhou, Y., Persson, P. O. Å., Rosen, J., & van Dijken, S. (2020). Tactile sensory coding and learning with bio-inspired optoelectronic spiking afferent nerves. Nature Communications, 11(1), [1369]. https://doi.org/10.1038/s41467-020-15105-2