Interpreting wide-band neural activity using convolutional neural networks
Citations Over TimeTop 10% of 2021 papers
Abstract
Rapid progress in technologies such as calcium imaging and electrophysiology has seen a dramatic increase in the size and extent of neural recordings. Even so, interpretation of this data requires considerable knowledge about the nature of the representation and often depends on manual operations. Decoding provides a means to infer the information content of such recordings but typically requires highly processed data and prior knowledge of the encoding scheme. Here, we developed a deep-learning framework able to decode sensory and behavioral variables directly from wide-band neural data. The network requires little user input and generalizes across stimuli, behaviors, brain regions, and recording techniques. Once trained, it can be analyzed to determine elements of the neural code that are informative about a given variable. We validated this approach using electrophysiological and calcium-imaging data from rodent auditory cortex and hippocampus as well as human electrocorticography (ECoG) data. We show successful decoding of finger movement, auditory stimuli, and spatial behaviors - including a novel representation of head direction - from raw neural activity.
Related Papers
- → Decoding continuous three-dimensional hand trajectories from epidural electrocorticographic signals in Japanese macaques(2012)97 cited
- Limitations of hybrid systems(2000)
- → Neural decoding of gait phase information during motor imagery and improvement of the decoding accuracy by concurrent action observation(2020)1 cited
- → A new design method for encoding and decoding circuits(2002)
- Design of fast RS encoding and decoding(2012)