Affiliation:
1. School of Geography, South China Normal University, Guangzhou 510631, China
Abstract
Thangka refers to a form of Tibetan Buddhist painting on a fabric, scroll, or Thangka, often depicting deities, scenes, or mandalas. Deep-learning-based super-resolution techniques have been applied to improve the spatial resolution of hyperspectral images (HSIs), especially for the preservation and analysis of Thangka cultural heritage. However, existing CNN-based methods encounter difficulties in effectively preserving spatial information, due to challenges such as registration errors and spectral variability. To overcome these limitations, we present a novel cross-sensor super-resolution (SR) framework that utilizes high-resolution RGBs (HR-RGBs) to enhance the spectral features in low-resolution hyperspectral images (LR-HSIs). Our approach utilizes spatial–spectral integration (SSI) blocks and spatial–spectral restoration (SSR) blocks to effectively integrate and reconstruct spatial and spectral features. Furthermore, we introduce a frequency multi-head self-attention (F-MSA) mechanism that treats high-, medium-, and low-frequency features as tokens, enabling self-attention computations across the frequency dimension. We evaluate our method on a custom dataset of ancient Thangka paintings and demonstrate its effectiveness in enhancing the spectral resolution in high-resolution hyperspectral images (HR-HSIs), while preserving the spatial characteristics of Thangka artwork with minimal information loss.
Funder
National Social Science Fund of China
Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University
Subject
General Earth and Planetary Sciences
Reference47 articles.
1. Conservation Treatment of Tibetan Thangkas;Shaftel;J. Am. Inst. Conserv.,1991
2. Conservation of Thangkas: A Review of the Literature since the 1970s;Cotte;Stud. Conserv.,2011
3. Wang, W., Qian, J., and Lu, X. (2012). Advanced Topics in Multimedia Research, InTech.
4. Damaged Region Filling by Improved Criminisi Image Inpainting Algorithm for Thangka;Yao;Clust. Comput.,2019
5. Thangka Mural Line Drawing Based on Cross Dense Residual Architecture and Hard Pixel Balancing;Wang;IEEE Access,2021