Adaptive weight multi-channel center similar deep hashing
Institution:
1. School of Electronic and Information Engineering, Anhui Jianzhu University, Hefei 230601, China;2. School of Mathematics, Hefei University of Technology, Hefei 230009, China;1. CSE Department, Bennett University, Greater Noida, UP,India;2. Department of IT, KIET Group of Institutions, Delhi-NCR, Ghaziabad, India;3. School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea;1. Institute of Carbon Neutrality and New Energy, School of Electronics and Information, Hangzhou Dianzi University, Hangzhou 310018, China;2. Zhejiang Provincial Key Lab of Equipment Electronics, Hangzhou Dianzi University, Hangzhou 310018, China
Abstract:
To increase the richness of the extracted text modality feature information and deeply explore the semantic similarity between the modalities. In this paper, we propose a novel method, named adaptive weight multi-channel center similar deep hashing (AMCDH). The algorithm first utilizes three channels with different configurations to extract feature information from the text modality; and then adds them according to the learned weight ratio to increase the richness of the information. We also introduce the Jaccard coefficient to measure the semantic similarity level between modalities from 0 to 1, and utilize it as the penalty coefficient of the cross-entropy loss function to increase its role in backpropagation. Besides, we propose a method of constructing center similarity, which makes the hash codes of similar data pairs close to the same center point, and dissimilar data pairs are scattered at different center points to generate high-quality hash codes. Extensive experimental evaluations on four benchmark datasets show that the performance of our proposed model AMCDH is significantly better than other competing baselines. The code can be obtained from https://github.com/DaveLiu6/AMCDH.git.
