TSGH: Two Stage Graph Hashing for Supervised Cross-Modal Retrieval

Author:

Sun Weijun1,Fang Yuhang1,Liao Tao1,Ni Haomin1,Li Chaoye1,Han Na2

Affiliation:

1. Guangdong University of Technology

2. Guangdong Polytechnic Normal University

Abstract

Abstract

Hashing cross-modal retrieval methods aim to retrieve different modalities and learn common semantics with low storage and time cost. Although many excellent hashing methods have been proposed in the past decades, there are still some issues. For example, most methods focus on the Euclidean domain, ignoring the graph-structure information contained in data points, so outliers and noise in the Euclidean domain will cause a drop in accuracy. Some methods only learn a latent subspace, which may be unreasonable because the dimensionality of the modalities is not the same as the distribution. To address these issues, we propose a hashing technique called Two Stage Graph Hashing (TSGH). In the first stage, we first learn a specific latent subspace for each modality using Collective Matrix Decomposition and the proposed Graph Convolutional Network (GCN). Therefore, the learned subspace contains the features of Euclidean and non-Euclidean domains, which can eliminate the influence of noise and outliers in the dataset. And then, Global Approximation is used to align the subspaces of the different modalities, so that high-level shared semantics can be explored. Finally, discrete hash codes are learned from the latent subspace and their semantic similarity. In the second stage, we design a linear classifier as the hash function and propose Local Similarity Preservation to capture the local relationship between hash codes and Hamming spaces. To verify the effectiveness of TSGH, we conduct extensive experiments on three public datasets. We achieve the best results compared to previous SOTA methods, illustrating the superiority of TSGH.

Publisher

Research Square Platform LLC

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3