TY - JOUR
T1 - Deep collaborative network with alpha matte for precise knee tissue segmentation from MRI
AU - Khan, Sheheryar
AU - Azam, Basim
AU - Yao, Yongcheng
AU - Chen, Weitian
N1 - Funding Information:
This work is supported by a grant from the Innovation and Technology Commission of the Hong Kong SAR (Project MRP/001/18X ), and Faculty Innovation Award from the Faculty of Medicine, the Chinese University of Hong Kong.
Publisher Copyright:
© 2022
PY - 2022/6/16
Y1 - 2022/6/16
N2 - Background and objective: Precise segmentation of knee tissues from magnetic resonance imaging (MRI) is critical in quantitative imaging and diagnosis. Convolutional neural networks (CNNs), being state of the art, often challenged by the lack of image-specific adaptation, such as low tissue contrasts and structural inhomogeneities, thereby leading to incomplete segmentation results. Methods: This paper presents a deep learning–based automatic segmentation framework for precise knee tissue segmentation. A novel deep collaborative method is proposed, which consists of an encoder–decoder-based segmentation network in combination with a low rank tensor-reconstructed segmentation network. Low rank reconstruction in MRI tensor sub-blocks is introduced to exploit the morphological variations in knee tissues. To model the tissue boundary regions and effectively utilize the superimposed regions, trimap generation is proposed for defining high, medium and low confidence regions from the multipath CNNs. The secondary path with low rank reconstructed input mitigates the conditions in which the primary segmentation network can potentially fail and overlook the boundary regions. The outcome of the segmentation is solved as an alpha matting problem by blending the trimap with the source input. Results: Experiments on Osteoarthritis Initiative (OAI) datasets with all the 6 musculoskeletal tissues provide an overall segmentation dice score of 0.8925, where Femoral and Tibial part of cartilage achieving an average dice exceeding 0.9. The volumetric metrics also indicate the superior performances in all tissue compartments. Conclusions: Experiments on Osteoarthritis Initiative (OAI) datasets and a self-prepared scan validate the effectiveness of the proposed method. Inclusion of extra prediction scale allowed the model to distinguish and segment the tissue boundary accurately. We specifically demonstrate the application of the proposed method in a cartilage segmentation–based thickness map for diagnosis purposes.
AB - Background and objective: Precise segmentation of knee tissues from magnetic resonance imaging (MRI) is critical in quantitative imaging and diagnosis. Convolutional neural networks (CNNs), being state of the art, often challenged by the lack of image-specific adaptation, such as low tissue contrasts and structural inhomogeneities, thereby leading to incomplete segmentation results. Methods: This paper presents a deep learning–based automatic segmentation framework for precise knee tissue segmentation. A novel deep collaborative method is proposed, which consists of an encoder–decoder-based segmentation network in combination with a low rank tensor-reconstructed segmentation network. Low rank reconstruction in MRI tensor sub-blocks is introduced to exploit the morphological variations in knee tissues. To model the tissue boundary regions and effectively utilize the superimposed regions, trimap generation is proposed for defining high, medium and low confidence regions from the multipath CNNs. The secondary path with low rank reconstructed input mitigates the conditions in which the primary segmentation network can potentially fail and overlook the boundary regions. The outcome of the segmentation is solved as an alpha matting problem by blending the trimap with the source input. Results: Experiments on Osteoarthritis Initiative (OAI) datasets with all the 6 musculoskeletal tissues provide an overall segmentation dice score of 0.8925, where Femoral and Tibial part of cartilage achieving an average dice exceeding 0.9. The volumetric metrics also indicate the superior performances in all tissue compartments. Conclusions: Experiments on Osteoarthritis Initiative (OAI) datasets and a self-prepared scan validate the effectiveness of the proposed method. Inclusion of extra prediction scale allowed the model to distinguish and segment the tissue boundary accurately. We specifically demonstrate the application of the proposed method in a cartilage segmentation–based thickness map for diagnosis purposes.
KW - Alpha matting
KW - Cartilage and meniscus segmentation
KW - Convolutional neural network
KW - Knee MRI
KW - Low rank decomposition
KW - Trimap
UR - http://www.scopus.com/inward/record.url?scp=85132774529&partnerID=8YFLogxK
U2 - 10.1016/j.cmpb.2022.106963
DO - 10.1016/j.cmpb.2022.106963
M3 - Article
C2 - 35752117
AN - SCOPUS:85132774529
SN - 0169-2607
VL - 222
JO - Computer Methods and Programs in Biomedicine
JF - Computer Methods and Programs in Biomedicine
M1 - 106963
ER -