19.5.5 Cross-Modal Indexing, Cross-Modal Retrieval

Costa Pereira, J., Coviello, E.[Emanuele], Doyle, G., Rasiwasia, N., Lanckriet, G.R.G.[Gert R.G.], Levy, R., Vasconcelos, N.M.,
On the Role of Correlation and Abstraction in Cross-Modal Multimedia Retrieval,
PAMI(36), No. 3, March 2014, pp. 521-535.
IEEE DOI 1403
image matching. E.g. use image to search for text. Correlation matching. Semantic matching. Semantic correlation matching. BibRef

Costa Pereira, J.[Jose], Vasconcelos, N.M.[Nuno M.],
Cross-modal domain adaptation for text-based regularization of image semantics in image retrieval systems,
CVIU(124), No. 1, 2014, pp. 123-135.
Elsevier DOI 1406
Content-based image retrieval BibRef

Zhai, X.H.[Xiao-Hua], Peng, Y.X.[Yu-Xin], Xiao, J.G.[Jian-Guo],
Learning Cross-Media Joint Representation With Sparse and Semisupervised Regularization,
CirSysVideo(24), No. 6, June 2014, pp. 965-978.
IEEE DOI 1407
Correlation BibRef

Peng, Y.X.[Yu-Xin], Qi, J.W.[Jin-Wei],
Quintuple-Media Joint Correlation Learning With Deep Compression and Regularization,
CirSysVideo(30), No. 8, August 2020, pp. 2709-2722.
IEEE DOI 2008
Media, Correlation, Semantics, Three-dimensional displays, Solid modeling, Data models, Image coding, Cross-media retrieval, network regularization BibRef

Peng, Y., Zhai, X., Zhao, Y., Huang, X.,
Semi-Supervised Cross-Media Feature Learning With Unified Patch Graph Regularization,
CirSysVideo(26), No. 3, March 2016, pp. 583-596.
IEEE DOI 1603
Correlation BibRef

Bellini, P.[Pierfrancesco], Cenni, D.[Daniele], Nesi, P.[Paolo],
Optimization of information retrieval for cross media contents in a best practice network,
MultInfoRetr(3), No. 3, September 2014, pp. 147-159.
Springer DOI 1408
BibRef

Kang, C., Xiang, S., Liao, S., Xu, C., Pan, C.,
Learning Consistent Feature Representation for Cross-Modal Multimedia Retrieval,
MultMed(17), No. 3, March 2015, pp. 370-381.
IEEE DOI 1502
Algorithm design and analysis BibRef

He, Y., Xiang, S., Kang, C., Wang, J., Pan, C.,
Cross-Modal Retrieval via Deep and Bidirectional Representation Learning,
MultMed(18), No. 7, July 2016, pp. 1363-1377.
IEEE DOI 1608
backpropagation BibRef

Zhang, S., Wang, X., Lin, Y., Tian, Q.,
Cross Indexing With Grouplets,
MultMed(17), No. 11, November 2015, pp. 1969-1979.
IEEE DOI 1511
Feature extraction BibRef

Chu, L., Zhang, Y., Li, G., Wang, S., Zhang, W., Huang, Q.,
Effective Multimodality Fusion Framework for Cross-Media Topic Detection,
CirSysVideo(26), No. 3, March 2016, pp. 556-569.
IEEE DOI 1603
Complexity theory BibRef

Ding, K.[Kun], Fan, B.[Bin], Huo, C.L.[Chun-Lei], Xiang, S.M.[Shi-Ming], Pan, C.H.[Chun-Hong],
Cross-Modal Hashing via Rank-Order Preserving,
MultMed(19), No. 3, March 2017, pp. 571-585.
IEEE DOI 1702
Binary codes BibRef

Jiang, B.[Bin], Yang, J.C.[Jia-Chen], Lv, Z.H.[Zhi-Han], Tian, K.[Kun], Meng, Q.G.[Qing-Gang], Yan, Y.[Yan],
Internet cross-media retrieval based on deep learning,
JVCIR(48), No. 1, 2017, pp. 356-366.
Elsevier DOI 1708
Cross-media, retrieval BibRef

Hu, Y., Zheng, L., Yang, Y., Huang, Y.,
Twitter100k: A Real-World Dataset for Weakly Supervised Cross-Media Retrieval,
MultMed(20), No. 4, April 2018, pp. 927-938.
IEEE DOI 1804
Electronic publishing, Encyclopedias, Internet, Optical character recognition software, Training, Visualization, weakly supervised method BibRef

Verma, Y.[Yashaswi], Jha, A.[Abhishek], Jawahar, C.V.,
Cross-specificity: modelling data semantics for cross-modal matching and retrieval,
MultInfoRetr(8), No. 2, June 2018, pp. 139-146.
Springer DOI 1805
BibRef

Dorfer, M.[Matthias], Schlüter, J.[Jan], Vall, A.[Andreu], Korzeniowski, F.[Filip], Widmer, G.[Gerhard],
End-to-end cross-modality retrieval with CCA projections and pairwise ranking loss,
MultInfoRetr(8), No. 2, June 2018, pp. 117-128.
Springer DOI 1805
BibRef

Lu, X.[Xu], Zhang, H.X.[Hua-Xiang], Sun, J.[Jiande], Wang, Z.H.[Zhen-Hua], Guo, P.[Peilian], Wan, W.[Wenbo],
Discriminative correlation hashing for supervised cross-modal retrieval,
SP:IC(65), 2018, pp. 221-230.
Elsevier DOI 1805
Cross-modal retrieval, Hashing, Subspace learning, Discriminant analysis BibRef

Wang, L.[Li], Zhu, L.[Lei], Dong, X.[Xiao], Liu, L.[Li], Sun, J.[Jiande], Zhang, H.X.[Hua-Xiang],
Joint Feature Selection and Graph Regularization for Modality-Dependent Cross-Modal Retrieval,
JVCIR(54), 2018, pp. 213-222.
Elsevier DOI 1806
Cross-modal retrieval, Feature selection, Subspace learning, Graph regularization BibRef

Zhong, F.M.[Fang-Ming], Chen, Z.K.[Zhi-Kui], Min, G.Y.[Ge-Yong],
Deep Discrete Cross-Modal Hashing for Cross-Media Retrieval,
PR(83), 2018, pp. 64-77.
Elsevier DOI 1808
Cross-modal retrieval, deep learning, discrete hashing, alternative optimization BibRef

Yuan, X.[Xu], Wang, G.Z.[Guang-Ze], Chen, Z.K.[Zhi-Kui], Zhong, F.M.[Fang-Ming],
CHOP: An orthogonal hashing method for zero-shot cross-modal retrieval,
PRL(145), 2021, pp. 247-253.
Elsevier DOI 2104
Zero-shot, Cross-modal retrieval, Orthogonal projection BibRef

Vukotic, V., Raymond, C., Gravier, G.,
A Crossmodal Approach to Multimodal Fusion in Video Hyperlinking,
MultMedMag(25), No. 2, April 2018, pp. 11-23.
IEEE DOI 1808
Computer architecture, Task analysis, Neural networks, Visualization, Streaming media, Hypertext systems, Training, multimedia BibRef

Liu, R., Wei, S., Zhao, Y., Zhu, Z., Wang, J.,
Multiview Cross-Media Hashing with Semantic Consistency,
MultMedMag(25), No. 2, April 2018, pp. 71-86.
IEEE DOI 1808
Media, Semantics, Correlation, Multimedia communication, Optimization, Feature extraction, hashing, cross-media, multiview, searching BibRef

Wang, D.[Di], Wang, Q.[Quan], Gao, X.[Xinbo],
Robust and Flexible Discrete Hashing for Cross-Modal Similarity Search,
CirSysVideo(28), No. 10, October 2018, pp. 2703-2715.
IEEE DOI 1811
Robustness, Training, Binary codes, Quantization (signal), Linear programming, Matrix decomposition, Sparse matrices, Hashing, unsupervised learning BibRef

Wang, D.[Di], Gao, X.B.[Xin-Bo], Wang, X.M.[Xiu-Mei], He, L.H.[Li-Huo],
Label Consistent Matrix Factorization Hashing for Large-Scale Cross-Modal Similarity Search,
PAMI(41), No. 10, October 2019, pp. 2466-2479.
IEEE DOI 1909
Semantics, Correlation, Training, Transforms, Binary codes, Image reconstruction, Sparse matrices, Hashing, multimodal, cross-modal BibRef

Wang, D.[Di], Gao, X.B.[Xin-Bo], Wang, X.M.[Xiu-Mei], He, L.[Lihuo], Yuan, B.[Bo],
Multimodal Discriminative Binary Embedding for Large-Scale Cross-Modal Retrieval,
IP(25), No. 10, October 2016, pp. 4540-4554.
IEEE DOI 1610
Internet BibRef

Wang, D.[Di], Wang, Q.[Quan], He, L.[Lihuo], Gao, X.B.[Xin-Bo], Tian, Y.[Yumin],
Joint and individual matrix factorization hashing for large-scale cross-modal retrieval,
PR(107), 2020, pp. 107479.
Elsevier DOI 2008
Hashing, Multimodal, Retrieval, Cross-modal, Matrix factorization BibRef

Dong, F.[Fei], Nie, X.S.[Xiu-Shan], Liu, X.B.[Xing-Bo], Geng, L.L.[Lei-Lei], Wang, Q.[Qian],
Cross-modal hashing based on category structure preserving,
JVCIR(57), 2018, pp. 28-33.
Elsevier DOI 1812
Cross-modal retrieval, Supervised hashing, Category-specific structure preserving BibRef

Zhang, M.J.[Mei-Jia], Zhang, H.X.[Hua-Xiang], Li, J.Z.[Jun-Zheng], Wang, L.[Li], Fang, Y.X.[Yi-Xian], Sun, J.[Jiande],
Supervised graph regularization based cross media retrieval with intra and inter-class correlation,
JVCIR(58), 2019, pp. 1-11.
Elsevier DOI 1901
Cross media retrieval, Subspace learning, Supervised graph regularization BibRef

Yao, T.[Tao], Wang, G.[Gang], Yan, L.S.[Lian-Shan], Kong, X.W.[Xiang-Wei], Su, Q.T.[Qing-Tang], Zhang, C.M.[Cai-Ming], Tian, Q.[Qi],
Online latent semantic hashing for cross-media retrieval,
PR(89), 2019, pp. 1-11.
Elsevier DOI 1902
Cross-media retrieval, Online learning, Hashing, Latent semantic concept BibRef

Yao, T.[Tao], Kong, X.W.[Xiang-Wei], Fu, H.Y.[Hai-Yan], Tian, Q.[Qi],
Discrete Semantic Alignment Hashing for Cross-Media Retrieval,
Cyber(50), No. 12, December 2020, pp. 4896-4907.
IEEE DOI 2012
Semantics, Hash functions, Correlation, Quantization (signal), Optimization, Task analysis, Internet, Attribute, hashing BibRef

Dutta, T.[Titir], Biswas, S.[Soma],
Cross-modal retrieval in challenging scenarios using attributes,
PRL(125), 2019, pp. 618-624.
Elsevier DOI 1909
Cross-modal retrieval, Attributes, Unseen query, Low-resolution data BibRef

Liu, H.P.[Hua-Ping], Wang, F.[Feng], Zhang, X.Y.[Xin-Yu], Sun, F.C.[Fu-Chun],
Weakly-paired deep dictionary learning for cross-modal retrieval,
PRL(130), 2020, pp. 199-206.
Elsevier DOI 2002
Deep dictionary learning, Cross-modal retrieval, Weak pairing BibRef

Zhang, H.[Hong], Wang, T.[Ting], Dai, G.[Gang],
Semi-supervised cross-modal common representation learning with vector-valued manifold regularization,
PRL(130), 2020, pp. 335-344.
Elsevier DOI 2002
Cross-media retrieval, Vector-valued RKHS, Manifold regularization, Semi-supervised, Kernel method BibRef

Chaudhuri, U.[Ushasi], Banerjee, B.[Biplab], Bhattacharya, A.[Avik], Datcu, M.[Mihai],
CMIR-NET: A deep learning based model for cross-modal retrieval in remote sensing,
PRL(131), 2020, pp. 456-462.
Elsevier DOI 2004
Remote sensing, Cross-modal retrieval, Deep learning, Panchromatic, Multispectral, Audio samples BibRef

Chi, J.Z.[Jing-Ze], Peng, Y.X.[Yu-Xin],
Zero-Shot Cross-Media Embedding Learning With Dual Adversarial Distribution Network,
CirSysVideo(30), No. 4, April 2020, pp. 1173-1187.
IEEE DOI 2004
Semantics, Media, Correlation, Training, Dogs, Measurement, Cross-media retrieval, zero-shot learning, maximum mean discrepancy BibRef

Wu, F.[Fei], Jing, X.Y.[Xiao-Yuan], Wu, Z.Y.[Zhi-Yong], Ji, Y.[Yimu], Dong, X.[Xiwei], Luo, X.[Xiaokai], Huang, Q.H.[Qing-Hua], Wang, R.[Ruchuan],
Modality-specific and shared generative adversarial network for cross-modal retrieval,
PR(104), 2020, pp. 107335.
Elsevier DOI 2005
Cross-modal retrieval, Generative adversarial networks (GAN), Modality-specific feature learning, Modality-shared feature learning BibRef

Zhong, F.M.[Fang-Ming], Chen, Z.K.[Zhi-Kui], Min, G.Y.[Ge-Yong], Xia, F.[Feng],
A novel strategy to balance the results of cross-modal hashing,
PR(107), 2020, pp. 107523.
Elsevier DOI 2008
Cross-modal hashing, Semantic gap, Semantic augmentation, Cross-modal retrieval BibRef

Peng, Y., Chi, J.,
Unsupervised Cross-Media Retrieval Using Domain Adaptation With Scene Graph,
CirSysVideo(30), No. 11, November 2020, pp. 4368-4379.
IEEE DOI 2011
Media, Correlation, Visualization, Genomics, Bioinformatics, Training data, Training, Cross-media retrieval, domain adaptation, scene graph BibRef

Zhu, L., Song, J., Zhu, X., Zhang, C., Zhang, S., Yuan, X.,
Adversarial Learning-Based Semantic Correlation Representation for Cross-Modal Retrieval,
MultMedMag(27), No. 4, October 2020, pp. 79-90.
IEEE DOI 2012
Correlation, Semantics, Computer science, Internet, Streaming media BibRef

Chaudhuri, U.[Ushasi], Banerjee, B.[Biplab], Bhattacharya, A.[Avik], Datcu, M.[Mihai],
CrossATNet: A novel cross-attention based framework for sketch-based image retrieval,
IVC(104), 2020, pp. 104003.
Elsevier DOI 2012
Neural networks, Sketch-based image retrieval, Cross-modal retrieval, Deep-learning, Cross-attention network, Cross-triplets BibRef

Zhang, Y., Zhou, W., Wang, M., Tian, Q., Li, H.,
Deep Relation Embedding for Cross-Modal Retrieval,
IP(30), 2021, pp. 617-627.
IEEE DOI 2012
Semantics, Feature extraction, Visualization, Computational modeling, Task analysis, Training, Optimization, relation BibRef

Zhang, L.[Lei], Chen, L.T.[Lei-Ting], Ou, W.H.[Wei-Hua], Zhou, C.[Chuan],
Semi-supervised cross-modal representation learning with GAN-based Asymmetric Transfer Network,
JVCIR(73), 2020, pp. 102899.
Elsevier DOI 2012
Cross-modal retrieval, Modality gap, Generative adversarial network BibRef

Wang, L.[Lu], Yang, J.[Jie], Zareapoor, M.[Masoumeh], Zheng, Z.L.[Zhong-Long],
Cluster-wise unsupervised hashing for cross-modal similarity search,
PR(111), 2021, pp. 107732.
Elsevier DOI 2012
Cross-modal similarity retrieval, Multi-view clustering, The cluster-wise code-prototypes, Cross-modal hashing, BibRef

Meng, M., Wang, H., Yu, J., Chen, H., Wu, J.,
Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval,
IP(30), 2021, pp. 986-1000.
IEEE DOI 2012
Semantics, Optimization, Quantization (signal), Correlation, Symmetric matrices, Image coding, Sparse matrices, multimedia BibRef

Matsubara, T.[Takashi],
Target-Oriented Deformation of Visual-Semantic Embedding Space,
IEICE(E104-D), No. 1, January 2021, pp. 24-33.
WWW Link. 2101
BibRef

Nie, X., Wang, B., Li, J., Hao, F., Jian, M., Yin, Y.,
Deep Multiscale Fusion Hashing for Cross-Modal Retrieval,
CirSysVideo(31), No. 1, January 2021, pp. 401-410.
IEEE DOI 2101
Semantics, Machine learning, Training data, Media, Correlation, Retrieval, hashing, deep learning, cross-modal BibRef

Liu, X.[Xin], Hu, Z.K.[Zhi-Kai], Ling, H.B.[Hai-Bin], Cheung, Y.M.[Yiu-Ming],
MTFH: A Matrix Tri-Factorization Hashing Framework for Efficient Cross-Modal Retrieval,
PAMI(43), No. 3, March 2021, pp. 964-981.
IEEE DOI 2102
Lips, Semantics, Adaptation models, Task analysis, Encoding, Correlation, Cross-modal retrieval, semantic correlation matrix BibRef

Wu, Y., Wang, S., Song, G., Huang, Q.,
Augmented Adversarial Training for Cross-Modal Retrieval,
MultMed(23), 2021, pp. 559-571.
IEEE DOI 2102
image representation, image retrieval, neural nets, text analysis, adversarial training process, adversa-rial training BibRef

Lin, Q., Cao, W., He, Z., He, Z.,
Mask Cross-Modal Hashing Networks,
MultMed(23), 2021, pp. 550-558.
IEEE DOI 2102
deep learning (artificial intelligence), feature extraction, file organisation, image retrieval, text analysis, cross-modal retrieval BibRef

Qi, M., Qin, J., Yang, Y., Wang, Y., Luo, J.,
Semantics-Aware Spatial-Temporal Binaries for Cross-Modal Video Retrieval,
IP(30), 2021, pp. 2989-3004.
IEEE DOI 2102
Semantics, Binary codes, Feature extraction, Visualization, Task analysis, Natural languages, Stochastic processes, natural language BibRef

Wu, J.L.[Jian-Long], Xie, X.X.[Xing-Xu], Nie, L.Q.[Li-Qiang], Lin, Z.C.[Zhou-Chen], Zha, H.B.[Hong-Bin],
Reconstruction regularized low-rank subspace learning for cross-modal retrieval,
PR(113), 2021, pp. 107813.
Elsevier DOI 2103
Cross-modal retrieval, Low-rank subspace learning, Reconstruction regularization BibRef

Zou, X.T.[Xi-Tao], Wang, X.Z.[Xin-Zhi], Bakker, E.M.[Erwin M.], Wu, S.[Song],
Multi-label semantics preserving based deep cross-modal hashing,
SP:IC(93), 2021, pp. 116131.
Elsevier DOI 2103
Multi-modal retrieval, Deep cross-modal hashing, Multi-label semantic learning BibRef

Thomas, C.[Christopher], Kovashka, A.[Adriana],
Preserving Semantic Neighborhoods for Robust Cross-modal Retrieval,
ECCV20(XVIII:317-335).
Springer DOI 2012
BibRef

Song, G., Tan, X.,
Sequential Learning for Cross-Modal Retrieval,
CroMoL19(4531-4539)
IEEE DOI 2004
information retrieval, learning (artificial intelligence), multimodal data, meta learning BibRef

Wang, Z., Liu, X., Li, H., Sheng, L., Yan, J., Wang, X., Shao, J.,
CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrieval,
ICCV19(5763-5772)
IEEE DOI 2004
entropy, feature extraction, image matching, image retrieval, message passing, natural language processing, text analysis, Task analysis BibRef

Huang, Y., Wang, L.,
ACMM: Aligned Cross-Modal Memory for Few-Shot Image and Sentence Matching,
ICCV19(5773-5782)
IEEE DOI 2004
image matching, learning (artificial intelligence), storage management, few-shot content, sentence matching tasks, Micromechanical devices BibRef

Nawaz, S., Janjua, M.K., Gallo, I., Mahmood, A., Calefati, A., Shafait, F.,
Do Cross Modal Systems Leverage Semantic Relationships?,
CroMoL19(4501-4510)
IEEE DOI 2004
image representation, image retrieval, image segmentation, learning (artificial intelligence), Text to Image BibRef

Su, S., Zhong, Z., Zhang, C.,
Deep Joint-Semantics Reconstructing Hashing for Large-Scale Unsupervised Cross-Modal Retrieval,
ICCV19(3027-3035)
IEEE DOI 2004
binary codes, image coding, image retrieval, multimedia computing, neural nets, binary codes, reconstructing framework, DJSRH, Correlation BibRef

Ning, X.C.[Xue-Cheng], Yang, X.S.[Xiao-Shan], Xu, C.S.[Chang-Sheng],
Multi-Hop Interactive Cross-modal Retrieval,
MMMod20(II:681-693).
Springer DOI 2003
BibRef

Cornia, M.[Marcella], Baraldi, L.[Lorenzo], Tavakoli, H.R.[Hamed R.], Cucchiara, R.[Rita],
Towards Cycle-Consistent Models for Text and Image Retrieval,
WiCV-E18(IV:687-691).
Springer DOI 1905
BibRef

Surís, D.[Didac], Duarte, A.[Amanda], Salvador, A.[Amaia], Torres, J.[Jordi], Giró-i-Nieto, X.[Xavier],
Cross-modal Embeddings for Video and Audio Retrieval,
WiCV-E18(IV:711-716).
Springer DOI 1905
BibRef

Liu, C.L.[Chen-Lu], Xu, X.[Xing], Yang, Y.[Yang], Lu, H.M.[Hui-Min], Shen, F.M.[Fu-Min], Ji, Y.L.[Yan-Li],
Domain Invariant Subspace Learning for Cross-Modal Retrieval,
MMMod18(II:94-105).
Springer DOI 1802
BibRef

Yuan, Y.X.[Yu-Xin], Peng, Y.X.[Yu-Xin],
Recursive Pyramid Network with Joint Attention for Cross-Media Retrieval,
MMMod18(I:405-416).
Springer DOI 1802
BibRef

Jia, Y.H.[Yu-Hua], Bai, L.[Liang], Wang, P.[Peng], Guo, J.L.[Jin-Lin], Xie, Y.X.[Yu-Xiang], Yu, T.Y.[Tian-Yuan],
Utilizing Locality-Sensitive Hash Learning for Cross-Media Retrieval,
MMMod17(I: 550-561).
Springer DOI 1701
BibRef

Shang, X.[Xindi], Zhang, H.[Hanwang], Chua, T.S.[Tat-Seng],
Deep Learning Generic Features for Cross-Media Retrieval,
MMMod16(I: 264-275).
Springer DOI 1601
BibRef

Huang, L.[Lei], Peng, Y.X.[Yu-Xin],
Cross-Media Retrieval via Semantic Entity Projection,
MMMod16(I: 276-288).
Springer DOI 1601
BibRef

Gu, Y.[Yun], Xue, H.Y.[Hao-Yang], Yang, J.[Jie], Shi, P.F.[Peng-Fei],
Cross-modality hashing with partial correspondence,
ICIP15(1925-1929)
IEEE DOI 1512
Cross-modality; Hashing; Multimedia Search; Partial Correspondence BibRef

Zhang, H.[Hong], Chen, L.[Li],
Learning optimal data representation for cross-media retrieval,
ICIP12(1925-1928).
IEEE DOI 1302
BibRef

Lin, W.X.[Wan-Xia], Lu, T.[Tong], Su, F.[Feng],
A Novel Multi-modal Integration and Propagation Model for Cross-Media Information Retrieval,
MMMod12(740-749).
Springer DOI 1201
BibRef

Chapter on Implementations and Applications, Databases, QBIC, Video Analysis, Hardware and Software, Inspection continues in
Video Delivery, Video-on-Demand, QoS, Indexing, Techniques Systems .