Fangyuan Wang, Xiyuan Wang, Taocun Yang, Weizhong Tang, Bo Xu, Bo Xu, Bo Xu, Bo Xu · Speech Communication 2026 · 2026
DOI: 10.1016/j.specom.2026.103490
Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).
The Conformer is the standard backbone for End-to-End (E2E) Automatic Speech Recognition (ASR), yet its quadratic complexity hinders streaming applications. While chunk-wise schemes offer linear complexity, they often suffer from limited cross-chunk interaction. We propose Swichformer ( Swi tch context powered ch unk-wise con former ), which introduces a “chunk-wise context-switch” mechanism to facilitate broad information exchange. Swichformer employs three partitioning strategies: regular (local context), shifted (adjacent left context), and sequential sampling (global historical context). This fusion enables the model to capture rich, complementary contextual information while preserving the efficiency of linear computation. Extensive evaluations on AISHELL-1/2, HKUST, LibriSpeech, and TED-LIUM3 demonstrate that Swichformer outperforms the evaluated chunk-wise baseline models, with roughly 3%–8% relative reductions in CER or WER. Furthermore, it achieves competitive performance compared with representative models that have substantially larger parameter counts and use Transducer decoding, as well as quadratic-complexity models (e.g., a CTC-only CER of 5.94% versus a Transducer CER of 5.78% for Emformer, and a two-pass CER of 5.09% versus 5.25% for U2 on AISHELL-1), while maintaining linear computational efficiency. These results suggest that Swichformer is a promising and efficient chunk-wise Conformer variant that performs strongly among the evaluated chunk-wise baselines and is competitive with representative history-aware streaming baselines. Source code will be released.
No comments yet — start the discussion below.