14.1.9.4.2 Zero-Shot Learning for Vision Transformers

Chapter Contents (Back)
Zero-Shot Learning. Vision Transformers. Transformers. ViT.

Chen, S.M.[Shi-Ming], Hong, Z.M.[Zi-Ming], Hou, W.J.[Wen-Jin], Xie, G.S.[Guo-Sen], Song, Y.B.[Yi-Bing], Zhao, J.[Jian], You, X.G.[Xin-Ge], Yan, S.C.[Shui-Cheng], Shao, L.[Ling],
TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning,
PAMI(45), No. 11, November 2023, pp. 12844-12861.
IEEE DOI 2310
BibRef

Chen, S.M.[Shi-Ming], Hou, W.J.[Wen-Jin], Khan, S.[Salman], Khan, F.S.[Fahad Shahbaz],
Progressive Semantic-Guided Vision Transformer for Zero-Shot Learning,
CVPR24(23964-23974)
IEEE DOI 2410
Visualization, Zero-shot learning, Fuses, Semantics, Benchmark testing, Performance gain, zero-shot learning BibRef

Naeem, M.F.[Muhammad Ferjad], Xian, Y.Q.[Yong-Qin], Van Gool, L.J.[Luc J.], Tombari, F.[Federico],
I2DFormer+: Learning Image to Document Summary Attention for Zero-Shot Image Classification,
IJCV(132), No. 1, January 2024, pp. 3806-3822.
Springer DOI 2409
BibRef

Naeem, M.F.[Muhammad Ferjad], Khan, M.G.Z.A.[Muhammad Gul Zain Ali], Xian, Y.Q.[Yong-Qin], Afzal, M.Z.[Muhammad Zeshan], Stricker, D.[Didier], Van Gool, L.J.[Luc J.], Tombari, F.[Federico],
I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classification,
CVPR23(15169-15179)
IEEE DOI 2309
BibRef

Wang, J.H.[Jing-Hua], Jiang, J.M.[Jian-Min],
Learning Across Tasks for Zero-Shot Domain Adaptation From a Single Source Domain,
PAMI(44), No. 10, October 2022, pp. 6264-6279.
IEEE DOI 2209
Task analysis, Correlation, Training, Generative adversarial networks, Animals, Semantics, domain generalization BibRef

Wang, J.H.[Jing-Hua], Jiang, J.M.[Jian-Min],
An Unsupervised Deep Learning Framework via Integrated Optimization of Representation Learning and GMM-Based Modeling,
ACCV18(I:249-265).
Springer DOI 1906
unsupervised deep learning framework. BibRef

Cheng, D.[De], Wang, G.[Gerong], Wang, B.[Bo], Zhang, Q.[Qiang], Han, J.G.[Jun-Gong], Zhang, D.W.[Ding-Wen],
Hybrid routing transformer for zero-shot learning,
PR(137), 2023, pp. 109270.
Elsevier DOI 2302
Zero-shot learning, Hybrid routing, Transformer, Attention BibRef

Ye, Z.H.[Zi-Han], Yang, G.Y.[Guan-Yu], Jin, X.B.[Xiao-Bo], Liu, Y.F.[You-Fa], Huang, K.Z.[Kai-Zhu],
Rebalanced Zero-Shot Learning,
IP(32), 2023, pp. 4185-4198.
IEEE DOI 2308
Semantics, Visualization, Training, Predictive models, Feature extraction, Transformers, Task analysis, reweighting strategy BibRef

Liu, M.[Man], Zhang, C.J.[Chun-Jie], Bai, H.H.[Hui-Hui], Zhao, Y.[Yao],
Part-Object Progressive Refinement Network for Zero-Shot Learning,
IP(33), 2024, pp. 2032-2043.
IEEE DOI Code:
WWW Link. 2403
Semantics, Visualization, Prototypes, Transformers, Training, Task analysis, Feature extraction, Zero-shot learning, prototype updating BibRef

Zhao, P.[Peng], Xi, X.M.[Xiao-Ming], Wang, Q.C.[Qiang-Chang], Yin, Y.L.[Yi-Long],
Characterizing Hierarchical Semantic-Aware Parts With Transformers for Generalized Zero-Shot Learning,
CirSysVideo(34), No. 11, November 2024, pp. 11493-11506.
IEEE DOI 2412
Prototypes, Semantics, Transformers, Tail, Zero-shot learning, Noise measurement, Circuits and systems, Transformer, prototype learning BibRef

Damalla, R.[Rambabu], Bendre, P.A.[Pratik Abhijeet], Gayathri, C., Datla, R.[Rajeshreddy], Chalavadi, V.[Vishnu],
TransRefine: Transformer-augmented feature refinement for zero-shot scene classification in remote sensing images,
PR(162), 2025, pp. 111406.
Elsevier DOI Code:
WWW Link. 2503
Zero-shot learning, Remote-sensing images, Scene classification BibRef


Son, S.[Seungwoo], Ryu, J.[Jegwang], Lee, N.[Namhoon], Lee, J.[Jaeho],
The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers,
ECCV24(LXVII: 379-396).
Springer DOI 2412
BibRef

Xu, K.X.[Kai-Xin], Wang, Z.[Zhe], Chen, C.Y.[Chun-Yun], Geng, X.[Xue], Lin, J.[Jie], Yang, X.[Xulei], Wu, M.[Min], Li, X.L.[Xiao-Li], Lin, W.S.[Wei-Si],
LPVIT: Low-power Semi-structured Pruning for Vision Transformers,
ECCV24(LXXI: 269-287).
Springer DOI 2412
BibRef

Su, D.[Diwei], Fei, C.[Cheng], Luo, J.X.[Jian-Xu],
Removing Rows and Columns of Tokens in Vision Transformer Enables Faster Dense Prediction Without Retraining,
ECCV24(LXXII: 325-341).
Springer DOI 2412
BibRef

Vo, X.T.[Xuan-Thuy], Nguyen, D.L.[Duy-Linh], Priadana, A.[Adri], Jo, K.H.[Kang-Hyun],
Efficient Vision Transformers with Partial Attention,
ECCV24(LXXXIII: 298-317).
Springer DOI 2412
BibRef

Yang, J.W.[Jia-Wei], Luo, K.Z.[Katie Z.], Li, J.F.[Jie-Feng], Deng, C.[Congyue], Guibas, L.J.[Leonidas J.], Krishnan, D.[Dilip], Weinberger, K.Q.[Kilian Q.], Tian, Y.[Yonglong], Wang, Y.[Yue],
Denoising Vision Transformers,
ECCV24(LXXXV: 453-469).
Springer DOI 2412
BibRef

Tian, B.[Bowei], Du, R.J.[Rui-Jie], Shen, Y.N.[Yan-Ning],
Fairvit: Fair Vision Transformer via Adaptive Masking,
ECCV24(LXV: 451-466).
Springer DOI 2412
BibRef

Hu, X.X.[Xi-Xu], Zheng, R.[Runkai], Wang, J.D.[Jin-Dong], Leung, C.H.[Cheuk Hang], Wu, Q.[Qi], Xie, X.[Xing],
Specformer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalization,
ECCV24(LIV: 345-362).
Springer DOI 2412
BibRef

Wang, H.J.[Hong-Jie], Dedhia, B.[Bhishma], Jha, N.K.[Niraj K.],
Zero-TPrune: Zero-Shot Token Pruning Through Leveraging of the Attention Graph in Pre-Trained Transformers,
CVPR24(16070-16079)
IEEE DOI Code:
WWW Link. 2410
Accuracy, Costs, Computational modeling, Transfer learning, Transformers, Throughput, token pruning, vision transformer, efficiency BibRef

Tartaglione, E.[Enzo],
The Rise of the Lottery Heroes: Why Zero-Shot Pruning is Hard,
ICIP22(2361-2365)
IEEE DOI 2211
Training, Deep learning, Computational modeling, Complexity theory, Optimization, The lottery ticket hypothesis, pruning, deep learning BibRef

Choi, Y.[Yoojin], El-Khamy, M.[Mostafa], Lee, J.[Jungwon],
Zero-Shot Learning of A Conditional Generative Adversarial Network for Data-Free Network Quantization,
ICIP21(3552-3556)
IEEE DOI 2201
Training, Quantization (signal), Image coding, Pipelines, Neural networks, Training data, Generative adversarial networks, quantization BibRef

Chapter on Pattern Recognition, Clustering, Statistics, Grammars, Learning, Neural Nets, Genetic Algorithms continues in
Data Augmentation, Generative Network, Convolutional Network .


Last update:Mar 17, 2025 at 20:02:03