Logo image
A Lightweight 3D Distillation Volumetric Transformer for 3D MRI Super-Resolution
Journal article

A Lightweight 3D Distillation Volumetric Transformer for 3D MRI Super-Resolution

Jianwei Zhao, Tao Hong, Hao Qi, Zhenghua Zhou and Hai Wang
IEEE journal of biomedical and health informatics, Vol.29(7), pp.5083-5094
2025
PMID: 40168216

Abstract

3D MRI super-resolution Bioinformatics Convolution Convolutional neural networks dual-attention Feature extraction Image reconstruction lightweight Magnetic resonance imaging multi scale feature distillation recursive volumetric transformer Superresolution Three-dimensional displays Transformers Visualization
Although existing 3D super-resolution methods for magnetic resonance imaging (MRI) volumetric data can provide better visual images than some traditional 2D methods, they should face challenge of increasing network's parameters and computing cost for getting higher reconstruction accuracy. To address this issue, a lightweight 3D multi scale distillation volumetric Transformer, named Transformer-based dual-attention feature distillation (TDAFD) network, is proposed for 3D MRI by utilizing 3D information hiding in images sufficiently. Our TDAFD network contains several proposed dual-attention feature distillation (DAFD) modules and two designed recursive volumetric Transformers (RVT). Concretely, the proposed DAFD module contains a multi-scale feature distillation (MSFD) block for extracting global features under different scales and a feature enhancement dual attention block (FEDAB) for concentrating on the key features better. In addition, our RVT develops 2D Transformer to 3D and save network's parameters via recursion operations for capturing long-term dependencies in volumetric images effectively. Therefore, our proposed TDAFD network can not only extract deeper features via multi scale feature distillation and Transformer, but also realize the balance of performances and network's parameters. Extensive experiments illustrate that our proposed method achieves superior reconstruction performances than some popular 3D MRI SR methods, and saves number of weights and FLOPs.

Details

Metrics

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Collaboration types
Domestic collaboration
International collaboration
Citation topics
4 Electrical Engineering, Electronics & Computer Science
4.101 Security, Encryption & Encoding
4.101.1178 Super-Resolution
Web Of Science research areas
Computer Science, Information Systems
Computer Science, Interdisciplinary Applications
Mathematical & Computational Biology
Medical Informatics
ESI research areas
Computer Science
Logo image