MyJournals Home  

RSS FeedsEntropy, Vol. 25, Pages 228: Improved Transformer-based Dual-path Network with Amplitude and Complex Domain Feature Fusion for Speech Enhancement (Entropy)

 
 

26 january 2023 10:54:21

 
Entropy, Vol. 25, Pages 228: Improved Transformer-based Dual-path Network with Amplitude and Complex Domain Feature Fusion for Speech Enhancement (Entropy)
 


Most previous speech enhancement methods only predict amplitude features, but more and more studies have proved that phase information is crucial for speech quality. Recently, there have also been some methods to choose complex features, but complex masks are difficult to estimate. Removing noise while maintaining good speech quality at low signal-to-noise ratios is still a problem. This study proposes a dual-path network structure for speech enhancement that can model complex spectra and amplitudes simultaneously, and introduces an attention-aware feature fusion module to fuse the two features to facilitate overall spectrum recovery. In addition, we improve a transformer-based feature extraction module that can efficiently extract local and global features. The proposed network achieves better performance than the baseline models in experiments on the Voice Bank + DEMAND dataset. We also conducted ablation experiments to verify the effectiveness of the dual-path structure, the improved transformer, and the fusion module, and investigated the effect of the input-mask multiplication strategy on the results.


 
55 viewsCategory: Informatics, Physics
 
Entropy, Vol. 25, Pages 227: Thermodynamic Assessment of the Effects of Intermittent Fasting and Fatty Liver Disease Diets on Longevity (Entropy)
Entropy, Vol. 25, Pages 229: Dissipation + Utilization = Self-Organization (Entropy)
 
 
blog comments powered by Disqus


MyJournals.org
The latest issues of all your favorite science journals on one page

Username:
Password:

Register | Retrieve

Search:

Physics


Copyright © 2008 - 2023 Indigonet Services B.V.. Contact: Tim Hulsen. Read here our privacy notice.
Other websites of Indigonet Services B.V.: Nieuws Vacatures News Tweets Nachrichten