TY - JOUR
T1 - From Neural Representations to Brain-Inspired Architecture
T2 - Decoding Auditory Target Perception in Complex Scenes
AU - Shi, Jianting
AU - Bi, Luzheng
AU - Wang, Jiaqi
AU - Wang, Jiarong
AU - Feleke, Aberham Genetu
AU - Fei, Weijie
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2026
Y1 - 2026
N2 - In complex acoustic scenarios, the human auditory system excels at rapidly and accurately identifying target sounds. A deeper understanding of its mechanisms in such environments could significantly enhance the robustness and generalization capabilities of sound event detection systems. This paper investigates the neural representations and decoding of target sound perception in complex auditory scenes using non-invasive neural signals. We propose a novel experimental paradigm that simulates complex acoustic conditions by varying parameters such as target sound characteristics, background noise levels, and interfering events. Multi-view neural representations— including time, frequency, and source domains—are extracted and analyzed using statistical methods to examine their relationships with these variables. To decode these neural activities, we propose the Auditory Cortex-inspired Dual Attention Network (AC-DANet), an architecture functionally inspired by known attentional pathways in the auditory cortex. The model achieves robust three-class Electroencephalogram (EEG) decoding for target sound perception in challenging auditory scenes, with experimental results demonstrating strong performance and cross subject generalization. This study advances our understanding of the neural information transmission process underlying sound target perception in complex acoustic environments. It offers novel insights into the cognitive functions of the human auditory system, while providing a theoretical foundation and technical framework for the development of advanced sound event detection systems in challenging acoustic settings.
AB - In complex acoustic scenarios, the human auditory system excels at rapidly and accurately identifying target sounds. A deeper understanding of its mechanisms in such environments could significantly enhance the robustness and generalization capabilities of sound event detection systems. This paper investigates the neural representations and decoding of target sound perception in complex auditory scenes using non-invasive neural signals. We propose a novel experimental paradigm that simulates complex acoustic conditions by varying parameters such as target sound characteristics, background noise levels, and interfering events. Multi-view neural representations— including time, frequency, and source domains—are extracted and analyzed using statistical methods to examine their relationships with these variables. To decode these neural activities, we propose the Auditory Cortex-inspired Dual Attention Network (AC-DANet), an architecture functionally inspired by known attentional pathways in the auditory cortex. The model achieves robust three-class Electroencephalogram (EEG) decoding for target sound perception in challenging auditory scenes, with experimental results demonstrating strong performance and cross subject generalization. This study advances our understanding of the neural information transmission process underlying sound target perception in complex acoustic environments. It offers novel insights into the cognitive functions of the human auditory system, while providing a theoretical foundation and technical framework for the development of advanced sound event detection systems in challenging acoustic settings.
KW - Complex Acoustic Scenario
KW - EEG
KW - Low SNR
KW - Neural signature
KW - Noninvasive Neural Signals
KW - Sound Target Perception
UR - https://www.scopus.com/pages/publications/105034791875
U2 - 10.1109/JBHI.2026.3679603
DO - 10.1109/JBHI.2026.3679603
M3 - Article
AN - SCOPUS:105034791875
SN - 2168-2194
JO - IEEE Journal of Biomedical and Health Informatics
JF - IEEE Journal of Biomedical and Health Informatics
ER -