17.1.3.9.2 Social Interactions, Human Activities, Social Grouping

Chapter Contents (Back)
Social Interactions. Human Interactions. Activity Recognition.
See also Human Activities, Interactions between People.
See also Human Activities, Crowds, Lots of People.

Varni, G.[Giovanna], Volpe, G.[Gualtiero], Camurri, A.[Antonio],
A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media,
MultMed(12), No. 6, 2010, pp. 576-590.
IEEE DOI 1003
BibRef
Earlier: A3, A1, A2:
Towards Analysis of Expressive Gesture in Groups of Users: Computational Models of Expressive Social Interaction,
GW09(122-133).
Springer DOI 0902
BibRef

Yan, X., Kakadiaris, I.A., Shah, S.K.,
Modeling local behavior for predicting social interactions towards human tracking,
PR(47), No. 4, 2014, pp. 1626-1641.
Elsevier DOI 1402
Human interaction BibRef

Yang, X., Zhang, T., Xu, C., Hossain, M.S.,
Automatic Visual Concept Learning for Social Event Understanding,
MultMed(17), No. 3, March 2015, pp. 346-358.
IEEE DOI 1502
Encyclopedias BibRef

Yang, X., Zhang, T., Xu, C.,
Deep-Structured Event Modeling for User-Generated Photos,
MultMed(20), No. 8, August 2018, pp. 2100-2113.
IEEE DOI 1808
convolution, feature extraction, feedforward neural nets, image recognition, deep learning BibRef

Hare, J.S.[Jonathon S.], Samangooei, S.[Sina], Niranjan, M.[Mahesan], Gibbins, N.[Nicholas],
Detection of social events in streams of social multimedia,
MultInfoRetr(4), No. 4, December 2015, pp. 289-302.
Springer DOI 1511
BibRef

Yu, Z., Wang, H., Guo, B., Gu, T., Mei, T.,
Supporting Serendipitous Social Interaction Using Human Mobility Prediction,
HMS(45), No. 6, December 2015, pp. 811-818.
IEEE DOI 1512
Accuracy BibRef

Sapru, A., Bourlard, H.,
Automatic Recognition of Emergent Social Roles in Small Group Interactions,
MultMed(17), No. 5, May 2015, pp. 746-760.
IEEE DOI 1505
Accuracy BibRef

Hong, R., Hu, Z., Liu, L., Wang, M., Yan, S., Tian, Q.,
Understanding Blooming Human Groups in Social Networks,
MultMed(17), No. 11, November 2015, pp. 1980-1988.
IEEE DOI 1511
Convolutional codes BibRef

Schinas, M.[Manos], Papadopoulos, S.[Symeon], Kompatsiaris, Y.F.[Yi-Fannis], Mitkas, P.A.[Pericles A.],
MGraph: multimodal event summarization in social media using topic models and graph-based ranking,
MultInfoRetr(5), No. 1, March 2016, pp. 51-69.
Springer DOI 1602
BibRef

Petkos, G.[Georgios], Papadopoulos, S.[Symeon], Schinas, E.[Emmanouil], Kompatsiaris, Y.F.[Yi-Fannis],
Graph-Based Multimodal Clustering for Social Event Detection in Large Collections of Images,
MMMod14(I: 146-158).
Springer DOI 1405
BibRef
Earlier: A1, A2, A4, Only:
Social event detection using multimodal clustering and integrating supervisory signals,
ICMR12(23).
DOI Link 1301

See also Social Multimedia Crawling for Mining and Search. BibRef

Phan, N.[Nhathai], Ebrahimi, J.[Javid], Kil, D.[Dave], Piniewski, B.[Brigitte], Dou, D.J.[De-Jing],
Topic-Aware Physical Activity Propagation in a Health Social Network,
IEEE_Int_Sys(31), No. 1, January 2016, pp. 5-14.
IEEE DOI 1602
Internet BibRef

Chaker, R.[Rima], Aghbari, Z.A.[Zaher Al], Junejo, I.N.[Imran N.],
Social network model for crowd anomaly detection and localization,
PR(61), No. 1, 2017, pp. 266-281.
Elsevier DOI 1609
Crowd modeling BibRef

Segalin, C.[Cristina], Cheng, D.S.[Dong Seon], Cristani, M.[Marco],
Social profiling through image understanding: Personality inference using convolutional neural networks,
CVIU(156), No. 1, 2017, pp. 34-50.
Elsevier DOI 1702
Image understanding BibRef

Machado, P.L.[Paulo Lima], de Sousa, R.T.[Rafael T.], de Oliveira Albuquerque, R.[Robson], García Villalba, L.J.[Luis Javier], Kim, T.H.[Tai-Hoon],
Detection of Electronic Anklet Wearers' Groupings throughout Telematics Monitoring,
IJGI(6), No. 1, 2017, pp. xx-yy.
DOI Link 1702
BibRef

Solera, F.[Francesco], Calderara, S., Ristani, E.[Ergys], Tomasi, C.[Carlo], Cucchiara, R.[Rita],
Tracking Social Groups Within and Across Cameras,
CirSysVideo(27), No. 3, March 2017, pp. 441-453.
IEEE DOI 1703
Adaptation models BibRef

Ristani, E.[Ergys], Solera, F.[Francesco], Zou, R.[Roger], Cucchiara, R.[Rita], Tomasi, C.[Carlo],
Performance Measures and a Data Set for Multi-target, Multi-camera Tracking,
MOTC16(II: 17-35).
Springer DOI 1611

WWW Link. Duke MTMC Dataset BibRef

Yigit, A.[Ahmet], Temizel, A.[Alptekin],
Individual and group tracking with the evaluation of social interactions,
IET-CV(11), No. 3, April 2017, pp. 255-263.
DOI Link 1704
BibRef

Sultana, M., Paul, P.P.[Padma Polash], Gavrilova, M.L.[Marina L.],
User Recognition From Social Behavior in Computer-Mediated Social Context,
HMS(47), No. 3, June 2017, pp. 356-367.
IEEE DOI 1706
Authentication, Biometrics (access control), Context, Next generation networking, Social network services, Stability analysis, Biometric security, human-machine interaction, information fusion, nonverbal behavior analysis, situation aware authentication, social behavioral (SB) biometrics, social context, user, recognition BibRef

Xu, J., Mei, T., Cai, R., Li, H., Rui, Y.,
Automatic Generation of Social Event Storyboard From Image Click-Through Data,
CirSysVideo(28), No. 1, January 2018, pp. 242-253.
IEEE DOI 1801
Data mining, Event detection, Internet, Search engines, Semantics, Time factors, Web search, Click-through data, event storyboard, social media BibRef

Liu, Z.W.[Zhe-Wei], Zhou, X.L.[Xiao-Lin], Shi, W.Z.[Wen-Zhong], Zhang, A.[Anshu],
Towards Detecting Social Events by Mining Geographical Patterns with VGI Data,
IJGI(7), No. 12, 2018, pp. xx-yy.
DOI Link 1901
BibRef

Zhou, L.H.[Li-Hua], Du, G.W.[Guo-Wang], Wang, R.X.[Ru-Xin], Tao, D.P.[Da-Peng], Wang, L.Z.[Li-Zhen], Cheng, J.[Jun], Wang, J.[Jing],
A tensor framework for geosensor data forecasting of significant societal events,
PR(88), 2019, pp. 27-37.
Elsevier DOI 1901
Internet of things (IoTs), Significant societal events, Geosensor data, Forecasting, Tensor decomposition BibRef

Xie, Z.[Zhao], Wu, T.F.[Tian-Fu], Yang, X.M.[Xing-Ming], Zhang, L.M.[Lu-Ming], Wu, K.W.[Ke-Wei],
Jointly social grouping and identification in visual dynamics with causality-induced hierarchical Bayesian model,
JVCIR(59), 2019, pp. 62-75.
Elsevier DOI 1903
Group activity detection and recognition, Casual context, Granger casual topic model BibRef

Yoo, H.[Haanju], Eom, T.[Taekyu], Seo, J.[Jeongmin], Choi, S.I.[Sang-Il],
Detection of interacting groups based on geometric and social relations between individuals in an image,
PR(93), 2019, pp. 498-506.
Elsevier DOI 1906
Detection, Combinatorial optimization BibRef

Pei, Z.[Zhao], Qi, X.N.[Xiao-Ning], Zhang, Y.N.[Yan-Ning], Ma, M.[Miao], Yang, Y.H.[Yee-Hong],
Human trajectory prediction in crowded scene using social-affinity Long Short-Term Memory,
PR(93), 2019, pp. 273-282.
Elsevier DOI 1906
Trajectory prediction, SAM pooling, Social-affinity LSTM BibRef

Yang, C.L.[Cui-Liu], Pei, Z.[Zhao],
Long-Short Term Spatio-Temporal Aggregation for Trajectory Prediction,
ITS(24), No. 4, April 2023, pp. 4114-4126.
IEEE DOI 2304
Trajectory, Transformers, Predictive models, Uncertainty, Dynamics, Convolutional neural networks, Convolution, trajectory prediction BibRef

Yan, H.B.[Hai-Bin], Song, C.H.[Chao-Hui],
Semantic three-stream network for social relation recognition,
PRL(128), 2019, pp. 78-84.
Elsevier DOI 1912
Social relation recognition, Deep neural networks, Face recognition, Biometrics BibRef

Lv, J.[Jinna], Wu, B.[Bin], Zhang, Y.L.[Yun-Lei], Xiao, Y.P.[Yun-Peng],
Attentive Sequences Recurrent Network for Social Relation Recognition from Video,
IEICE(E102-D), No. 12, December 2019, pp. 2568-2576.
WWW Link. 1912
BibRef

Teng, Y.Y.[Yi-Yang], Song, C.G.[Chen-Guang], Wu, B.[Bin],
Learning Social Relationship From Videos via Pre-Trained Multimodal Transformer,
SPLetters(29), 2022, pp. 1377-1381.
IEEE DOI 2206
Visualization, Transformers, Task analysis, Videos, Semantics, Indexes, Feature extraction, Social relation recognition, multimodal Transformer BibRef

Lv, J.[Jinna], Liu, W.[Wu], Zhou, L.L.[Li-Li], Wu, B.[Bin], Ma, H.D.[Hua-Dong],
Multi-stream Fusion Model for Social Relation Recognition from Videos,
MMMod18(I:355-368).
Springer DOI 1802
BibRef

Lv, J.[Jinna], Wu, B.[Bin],
Spatio-Temporal Attention Model Based on Multi-view for Social Relation Understanding,
MMMod19(II:390-401).
Springer DOI 1901
BibRef

Liu, X.C.[Xin-Chen], Liu, W.[Wu], Zhang, M.[Meng], Chen, J.W.[Jing-Wen], Gao, L.L.[Lian-Li], Yan, C.G.[Cheng-Gang], Mei, T.[Tao],
Social Relation Recognition From Videos via Multi-Scale Spatial-Temporal Reasoning,
CVPR19(3561-3569).
IEEE DOI 2002
BibRef

Teng, Y.Y.[Yi-Yang], Song, C.G.[Chen-Guang], Wu, B.[Bin],
Recognizing Social Relationships in Long Videos via Multimodal Character Interaction,
SPLetters(30), 2023, pp. 573-577.
IEEE DOI 2306
Videos, Feature extraction, Visualization, Faces, Character recognition, Face recognition, Cognition, video understanding BibRef

Wan, Y.[You], Tan, X.C.[Xi-Cheng], Shu, H.[Hua],
Finding and Evaluating Community Structures in Spatial Networks,
IJGI(12), No. 5, 2023, pp. xx-yy.
DOI Link 2306
BibRef

Sousa, E.V.[Eduardo V.], Macharet, D.G.[Douglas G.],
Structural reasoning for image-based social relation recognition,
CVIU(235), 2023, pp. 103785.
Elsevier DOI 2310
Social relation recognition, Scene understanding, Group interaction, Image classification BibRef

Guan, Z.Y.[Zi-Yu], Zhao, W.Q.[Wan-Qing], Liu, H.M.[Hong-Min], Nakashima, Y.[Yuta], Babaguchi, N.[Noboru], He, X.F.[Xiao-Fei],
Cross-Modal Guided Visual Representation Learning for Social Image Retrieval,
PAMI(47), No. 3, March 2025, pp. 2186-2198.
IEEE DOI 2502
Visualization, Semantics, Training, Noise measurement, Image retrieval, Representation learning, Noise, Image coding, a priori common-sense relationship BibRef

Berlincioni, L.[Lorenzo], Cultrera, L.[Luca], Bertini, M.[Marco], del Bimbo, A.[Alberto],
Navigating social contexts: A transformer approach to relationship recognition,
CVIU(254), 2025, pp. 104327.
Elsevier DOI 2503
Social relation recognition, Computer vision, Human computer interaction BibRef

He, H.Y.[Hong-Yuan], Wang, D.M.[Da-Ming], Hasan, M.R.[Md Rakibul], Gedeon, T.[Tom], Hossain, M.Z.[Md Zakir],
TCA-NET: Triplet Concatenated-Attentional Network for Multimodal Engagement Estimation,
ICIP24(2062-2068)
IEEE DOI Code:
WWW Link. 2411
Visualization, Noise, Education, Estimation, Medical services, Predictive models, Engagement estimation, attention network, deep learning BibRef

Lee, S.[Sangmin], Lai, B.[Bolin], Ryan, F.[Fiona], Boote, B.[Bikram], Rehg, J.M.[James M.],
Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations,
CVPR24(14585-14595)
IEEE DOI Code:
WWW Link. 2410
Visualization, Annotations, Source coding, Games, Communication channels, Predictive models BibRef