22.3.6.1.4 Face Expression Recognition for Human Comupter Interaction

Ando, M.[Mitsuhiro],
System for recognizing image,
US_Patent5,008,946, Apr 16, 1991
WWW Link. Eye or mouth gesture control. BibRef 9104

Picard, R.W.[Rosalind W.],
Affective Perception,
CACM(43), No. 3, March 2000, pp. 50-51. BibRef 0003
And: MIT Press1997. 0003
(Actually a sidebar.) Recognition of emotions. BibRef

Picard, R.W.[Rosalind W.], Klein, J.[Jonathan],
Computers that Recognize and Respond to User Emotion: Theoretical and Practical Implications,
Vismod-538, 2001.
HTML Version. BibRef 0100

Picard, R.W.[Rosalind W.],
Building HAL: Computers that sense, recognize, and respond to human emotion,
Vismod-532, 2001. Also in: Society of Photo-Optical Instrumentation Engineers. Human Vision and Electronic Imaging VI, part of IS&T/SPIE9s Photonics West 2001
PDF File. 0105
BibRef

Picard, R.W.[Rosalind W.],
Toward computers that recognize and respond to user emotion,
IBMSystem(39), No. 3/4, 2000, pp. xx-yy. BibRef 0001
And: Vismod-535, 2000. BibRef
And:
HTML Version.
HTML Version. 0105
BibRef

Scheirer, J.[Jocelyn], Fernandez, R.[Raul], Picard, R.W.[Rosalind W.],
Expression Glasses: A Wearable Device for Facial Expression Recognition,
Vismod--484, February 1999
PS File. BibRef 9902

Scheirer, J., Fernandez, R., Klein, J., and Picard, R.W.[Rosalind W.],
Frustratring the User on Purpose: A Step Toward Building an Affective Computer,
Vismod--509, October 1999.
PS File. BibRef 9910

Scheirer, J.[Jocelyn], and Picard, R.W.[Rosalind W.],
Affective Objects,
Vismod--524, March 2000.
HTML Version. BibRef 0003

Picard, R.W.[Rosalind W.],
Affective Computing for HCI,
Vismod--490, August 1999.
HTML Version. BibRef 9908

Vyzas, E.[Elias], and Picard, R.W.[Rosalind W.],
Affective Pattern Classification,
Vismod--473. September 1998.
PS File. BibRef 9809

Picard, R.W., and Cosier, G.,
Affective Intelligence: The Missing Link,
Vismod--448, October 1997.
HTML Version. BibRef 9710

Picard, R.W.[Rosalind W.], Vyzas, E.[Elias], Healey, J.[Jennifer],
Toward Machine Emotional Intelligence: Analysis of Affective Physiological State,
PAMI(23), No. 10, October 2001, pp. 1175-1191.
IEEE DOI 0110
Emotion recognition. Deal with issues of day-to-day changes BibRef

Picard, R.W.[Rosalind W.], Healey, J.[Jennifer],
Affective Wearables,
Vismod--467, December 1997.
HTML Version. BibRef 9712

Healey, J.[Jennifer], and Picard, R.W.[Rosalind W.],
Digital Processing of Affective Signals,
ICASSP98(xx) BibRef 9800
And: Vismod--444, 1997.
HTML Version. BibRef

Hoque, M.E.[Mohammed Ehsan], Picard, R.W.[Rosalind W.],
Rich Nonverbal Sensing Technology for Automated Social Skills Training,
Computer(47), No. 4, April 2014, pp. 28-35.
IEEE DOI 1405
BibRef
Earlier:
Acted vs. natural frustration and delight: Many people smile in natural frustration,
FG11(354-359).
IEEE DOI 1103
Behavioral science BibRef

Hoque, M.E.[Mohammed Ehsan], McDuff, D.J.[Daniel J.], Picard, R.W.[Rosalind W.],
Exploring Temporal Patterns in Classifying Frustrated and Delighted Smiles,
AffCom(3), No. 3, 2012, pp. 323-334.
IEEE DOI 1210
BibRef

Howell, A.J.[A. Jonathan], Buxton, H.[Hilary],
Active vision techniques for visually mediated interaction,
IVC(20), No. 12, October 2002, pp. 861-871.
Elsevier DOI 0210
BibRef
And: ICPR02(II: 296-299).
IEEE DOI 0211
BibRef
Earlier:
Face Detection and Attentional Frames for Visually Mediated Interaction,
HUMO00(143-148).
IEEE Top Reference. 0010
Identity, expression, head pose, gesture based communication.
See also Gesture Recognition for Visually Mediated Interaction. BibRef

Zhu, Y., de Silva, L.C., Ko, C.C.,
Using moment invariants and HMM in facial expression recognition,
PRL(23), No. 1-3, January 2002, pp. 83-91.
Elsevier DOI 0201
BibRef

Sekmen, A.S., Wilkes, M., Kawamura, K.,
An application of passive human-robot interaction: Human tracking based on attention distraction,
SMC-A(32), No. 2, March 2002, pp. 248-259.
IEEE Top Reference. 0207
BibRef

de Silva, C.R.[Chathura R.], Ranganath, S.[Surendra], de Silva, L.C.[Liyanage C.],
Cloud basis function neural network: A modified RBF network architecture for holistic facial expression recognition,
PR(41), No. 4, April 2008, pp. 1241-1253.
Elsevier DOI 0801
Radial basis functions (RBF); Neural networks; Facial expression recognition; High-dimensional classifiers; Holistic classification; Human-computer interface BibRef

Dornaika, F.[Fadi], Raducanu, B.[Bogdan],
Inferring facial expressions from videos: Tool and application,
SP:IC(22), No. 9, October 2007, pp. 769-784.
Elsevier DOI 0711
BibRef
Earlier:
Recognizing Facial Expressions in Videos Using a Facial Action Analysis-Synthesis Scheme,
AVSBS06(8-8).
IEEE DOI 0611
Facial expression recognition; Temporal classifiers; Keyframes; Human machine interaction; AIBO robot BibRef

Raducanu, B.[Bogdan], Dornaika, F.[Fadi],
Texture-independent recognition of facial expressions in image snapshots and videos,
MVA(24), No. 4, May 2013, pp. 811-820.
WWW Link. 1304
BibRef
Earlier:
Natural Facial Expression Recognition Using Dynamic and Static Schemes,
ISVC09(I: 730-739).
Springer DOI 0911
BibRef

Dornaika, F.[Fadi], Raducanu, B.[Bogdan],
Three-Dimensional Face Pose Detection and Tracking Using Monocular Videos: Tool and Application,
SMC-B(39), No. 4, August 2009, pp. 935-944.
IEEE DOI 0906
BibRef

Raducanu, B.[Bogdan], Dornaika, F.[Fadi],
Pose-Invariant Face Recognition in Videos for Human-Machine Interaction,
CVVT12(II: 566-575).
Springer DOI 1210
BibRef

Cohen, I.[Ira], Sebe, N.[Nicu], Garg, A.[Ashutosh], Chen, L.S.[Lawrence S.], Huang, T.S.[Thomas S.],
Facial Expression Recognition from Video Sequences: Temporal and Static Modeling,
CVIU(91), No. 1-2, July-August 2003, pp. 160-187.
Elsevier DOI 0309
BibRef

Cohen, I.[Ira], Cozman, F.G., Sebe, N., Cirelo, M.C., Huang, T.S.,
Semisupervised Learning of Classifiers: Theory, Algorithms, and Their Application to Human-Computer Interaction,
PAMI(26), No. 12, December 2004, pp. 1553-1567.
IEEE Abstract. 0411
BibRef
Earlier: A1, A3, A2, A4, A5:
Learning Bayesian network classifiers for facial expression recognition using both labeled and unlabeled data,
CVPR03(I: 595-601).
IEEE DOI 0307

See also Authentic facial expression analysis. BibRef

Hupont, I.[Isabelle], Cerezo, E.[Eva], Baldassarri, S.[Sandra],
Facial Emotional Classifier For Natural Interaction,
ELCVIA(7), No. 4, 2008, pp. 1-12.
DOI Link 0806
BibRef

d'Mello, S.K., Dowell, N., Graesser, A.,
Unimodal and Multimodal Human Perception of Naturalistic Non-Basic Affective States During Human-Computer Interactions,
AffCom(4), No. 4, October 2013, pp. 452-465.
IEEE DOI 1406
behavioural sciences computing BibRef

Novielli, N., Strapparava, C.,
The Role of Affect Analysis in Dialogue Act Identification,
AffCom(4), No. 4, October 2013, pp. 439-451.
IEEE DOI 1406
behavioural sciences computing BibRef

Whitehill, J., Serpell, Z., Lin, Y., Foster, A., Movellan, J.R.,
The Faces of Engagement: Automatic Recognition of Student Engagement from Facial Expressions,
AffCom(5), No. 1, January 2014, pp. 86-98.
IEEE DOI 1407
Games BibRef

Barakova, E.I., Gorbunov, R., Rauterberg, M.,
Automatic Interpretation of Affective Facial Expressions in the Context of Interpersonal Interaction,
HMS(45), No. 4, August 2015, pp. 409-418.
IEEE DOI 1506
Computers BibRef

Zhang, L.[Li], Mistry, K.[Kamlesh], Jiang, M.[Ming], Neoh, S.C.[Siew Chin], Hossain, M.A.[Mohammed Alamgir],
Adaptive facial point detection and emotion recognition for a humanoid robot,
CVIU(140), No. 1, 2015, pp. 93-114.
Elsevier DOI 1509
Facial point detection BibRef

Han, J.H.[Ji-Hyeong], Choi, S.H.[Seung-Hwan], Kim, J.H.[Jong-Hwan],
Interactive Human Intention Reading by Learning Hierarchical Behavior Knowledge Networks for Human-Robot Interaction,
ETRI(38), No. 6, December 2016, pp. 1229-1239.
DOI Link 1612
BibRef

Tanisik, G.[Gokhan], Zalluhoglu, C.[Cemil], Ikizler-Cinbis, N.[Nazli],
Facial descriptors for human interaction recognition in still images,
PRL(73), No. 1, 2016, pp. 44-51.
Elsevier DOI 1604
Human interaction recognition BibRef

Batrinca, L., Mana, N., Lepri, B., Sebe, N., Pianesi, F.,
Multimodal Personality Recognition in Collaborative Goal-Oriented Tasks,
MultMed(18), No. 4, April 2016, pp. 659-673.
IEEE DOI 1604
Acoustics BibRef

Tavares, G.[Gonçalo], Mourão, A.[André], Magalhães, J.[João],
Crowdsourcing facial expressions for affective-interaction,
CVIU(147), No. 1, 2016, pp. 102-113.
Elsevier DOI 1605
Affective-interaction BibRef

Cao, N.T.[Nhan Thi], Ton-That, A.H.[An Hoa], Choi, H.I.[Hyung-Il],
An effective facial expression recognition approach for intelligent game systems,
IJCVR(6), No. 3, 2016, pp. 223-234.
DOI Link 1608
BibRef

Han, J.H., Lee, S.J., Kim, J.H.,
Behavior Hierarchy-Based Affordance Map for Recognition of Human Intention and Its Application to Human-Robot Interaction,
HMS(46), No. 5, October 2016, pp. 708-722.
IEEE DOI 1610
control engineering computing BibRef

Kruijff, E.[Ernst], Marquardt, A.[Alexander], Trepkowski, C.[Christina], Schild, J.[Jonas], Hinkenjann, A.[André],
Designed emotions: challenges and potential methodologies for improving multisensory cues to enhance user engagement in immersive systems,
VC(33), No. 4, April 2017, pp. 471-488.
Springer DOI 1704
BibRef

Chi, J.[Jing], Gao, S.S.[Shan-Shan], Zhang, C.M.[Cai-Ming],
Interactive facial expression editing based on spatio-temporal coherency,
VC(33), No. 6-8, June 2017, pp. 981-991.
WWW Link. 1706
BibRef

Poore, J.C., Webb, A.K., Cunha, M.G., Mariano, L.J., Chappell, D.T., Coskren, M.R., Schwartz, J.L.,
Operationalizing Engagement with Multimedia as User Coherence with Context,
AffCom(8), No. 1, January 2017, pp. 95-107.
IEEE DOI 1703
Coherence BibRef

Li, W.[Wei], Tsangouri, C.[Christina], Abtahi, F.[Farnaz], Zhu, Z.G.[Zhi-Gang],
A recursive framework for expression recognition: From web images to deep models to game dataset,
MVA(29), No. 3, April 2018, pp. 489-502.
Springer DOI 1804
Integrate facial dataset generation, facial expression recognition model building, and interactive interfaces for testing and new data collection. BibRef

Shi, Y.[Yan], Zhang, Z.J.[Zi-Jun], Huang, K.N.[Kai-Ning], Ma, W.[Wudi], Tu, S.S.[Shan-Shan],
Human-computer interaction based on face feature localization,
JVCIR(70), 2020, pp. 102740.
Elsevier DOI 2007
Human interaction, Face point detection, Expression recognition, Sight tracking BibRef

Turan, C.[Cigdem], Neergaard, K.D.[Karl David], Lam, K.M.[Kin-Man],
Facial Expressions of Comprehension (FEC),
AffCom(13), No. 1, January 2022, pp. 335-346.
IEEE DOI 2203
Databases, Computational modeling, Videos, Animation, Neuroscience, Analytical models, Face recognition, sentence comprehension BibRef

Chen, X.[Xu], Niu, L.[Li], Veeraraghavan, A.[Ashok], Sabharwal, A.[Ashutosh],
FaceEngage: Robust Estimation of Gameplay Engagement from User-Contributed (YouTube) Videos,
AffCom(13), No. 2, April 2022, pp. 651-665.
IEEE DOI 2206
Videos, Task analysis, Atmospheric measurements, Particle measurements, Games, YouTube, Estimation, deep neural networks BibRef

Olugbade, T.A.[Temitayo A.], Newbold, J.[Joseph], Johnson, R.[Rose], Volta, E.[Erica], Alborno, P.[Paolo], Niewiadomski, R.[Radoslaw], Dillon, M.[Max], Volpe, G.[Gualtiero], Bianchi-Berthouze, N.[Nadia],
Automatic Detection of Reflective Thinking in Mathematical Problem Solving Based on Unconstrained Bodily Exploration,
AffCom(13), No. 2, April 2022, pp. 944-957.
IEEE DOI 2206
Problem-solving, Games, Observers, Task analysis, Neural networks, Education, Annotations, Affect sensing and analysis, education, neural nets BibRef

Chen, K.Y.[Ke-Yu], Yang, X.[Xu], Fan, C.J.[Chang-Jie], Zhang, W.[Wei], Ding, Y.[Yu],
Semantic-Rich Facial Emotional Expression Recognition,
AffCom(13), No. 4, October 2022, pp. 1906-1916.
IEEE DOI 2212
Emotion recognition, Semantics, Face recognition, Psychology, Linguistics, Human computer interaction, Feature extraction, image analysis BibRef

Huynh, V.T.[Van Thong], Yang, H.J.[Hyung-Jeong], Lee, G.S.[Guee-Sang], Kim, S.H.[Soo-Hyung],
Prediction of evoked expression from videos with temporal position fusion,
PRL(172), 2023, pp. 245-251.
Elsevier DOI 2309
Evoked expression, Direct video affective content analysis, Affective Computing BibRef

Mao, J.W.[Jia-Wei], Xu, R.[Rui], Yin, X.S.[Xue-Song], Chang, Y.Q.[Yuan-Qi], Nie, B.L.[Bin-Ling], Huang, A.[Aibin], Wang, Y.G.[Yi-Gang],
POSTER++: A simpler and stronger facial expression recognition network,
PR(157), 2025, pp. 110951.
Elsevier DOI 2409
Facial expression recognition, Inrdustry deployment, Window attention mechanism BibRef

Stammer, W.[Wolfgang], Memmel, M.[Marius], Schramowski, P.[Patrick], Kersting, K.[Kristian],
Interactive Disentanglement: Learning Concepts by Interacting with their Prototype Representations,
CVPR22(10307-10318)
IEEE DOI 2210
Deep learning, Representation learning, Human computer interaction, Visualization, Prototypes, Cognition, Visual reasoning BibRef

Liu, D.[Dan], Zhang, L.[Libo], Wu, Y.J.[Yan-Jun],
LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture Recognition,
CVPR22(3294-3302)
IEEE DOI 2210
Human computer interaction, Uncertainty, Annotations, Image color analysis, Machine vision, Estimation, Vision applications and systems BibRef

Guerdan, L.[Luke], Raymond, A.[Alex], Gunes, H.[Hatice],
Toward Affective XAI: Facial Affect Analysis for Understanding Explainable Human-AI Interactions,
RPRMI21(3789-3798)
IEEE DOI 2112
Decision making, Machine learning, Task analysis, Lenses BibRef

Abedi, A.[Ali], Khan, S.S.[Shehroz S.],
Improving state-of-the-art in Detecting Student Engagement with Resnet and TCN Hybrid Network,
CRV21(151-157)
IEEE DOI 2108
Neural networks, Feature extraction, Robots, Videos, Residual neural networks, engagement detection, spatio-temporal, Residual Neural Network BibRef

Guness, S.P.[Shivanand P.], Deravi, F.[Farzin], Sirlantzis, K.[Konstantinos], Pepper, M.G.[Matthew G.], Sakel, M.[Mohammed],
Development and Evaluation of a Mouse Emulator Using Multi-modal Real-time Head Tracking Systems with Facial Gesture Recognition as a Switching Mechanism,
CARE20(218-232).
Springer DOI 2103
BibRef

Baglayici, E.[Engin], Gurpinar, C.[Cemal], Uluer, P.[Pinar], Kose, H.[Hatice],
A New Facial Expression Processing System for an Affectively Aware Robot,
CAIHA20(36-51).
Springer DOI 2103
BibRef

Devillers, L., Rosset, S., Dubuisson Duplessis, G., Bechade, L., Yemez, Y., Turker, B.B., Sezgin, M., Erzin, E., El Haddad, K., Dupont, S., Deleglise, P., Esteve, Y., Lailler, C., Gilmartin, E., Campbell, N.,
Multifaceted Engagement in Social Interaction with a Machine: The JOKER Project,
FG18(697-701)
IEEE DOI 1806
Data collection, Linguistics, Robots, Speech recognition, Standards, Task analysis, Vocabulary, Affective Computing, Dataset, Engagement, Speech Recognition BibRef

Bruce, J., Perron, J., Vaughan, R.,
Ready-Aim-Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs,
CRV17(307-313)
IEEE DOI 1804
autonomous aerial vehicles, face recognition, human-robot interaction, mobile robots, pose estimation, unmanned aerial vehicle BibRef

Bhaskar, H.[Harish], La Torre, D.[Davide], Al-Mualla, M.[Mohammed],
Posed Facial Expression Detection Using Reflection Symmetry and Structural Similarity,
ICIAR15(218-228).
Springer DOI 1507
BibRef

Aly, A., Tapus, A.,
Towards an online fuzzy modeling for human internal states detection,
ICARCV12(1563-1570).
IEEE DOI 1304
BibRef

Castillo, G.[Gonzalo], Avendaño, S.[Santiago], Goussies, N.A.[Norberto Adrián],
An Human-computer Interface Using Facial Gestures for the Game of Truco,
CIARP12(276-283).
Springer DOI 1209
BibRef

Sun, X.F.[Xiao-Fan], Nijholt, A.[Anton], Truong, K.P.[Khiet P.], Pantic, M.[Maja],
Automatic visual mimicry expression analysis in interpersonal interaction,
CVPR4HB11(40-46).
IEEE DOI 1106
BibRef

Lang, C.[Christian], Wachsmuth, S.[Sven], Wersing, H.[Heiko], Hanheide, M.[Marc],
Facial expressions as feedback cue in human-robot interaction: A comparison between human and automatic recognition performances,
CVPR4HB10(79-85).
IEEE DOI 1006
BibRef

Wimmer, M.[Matthias], MacDonald, B.A.[Bruce A.], Jayamuni, D.[Dinuka], Yadav, A.[Arpit],
Facial Expression Recognition for Human-Robot Interaction: A Prototype,
RobVis08(139-152).
Springer DOI 0802

See also Markerless Augmented Reality for Robotic Helicoptor Applications. BibRef

Kobayashi, T., Ogawa, Y., Kato, K., Yamamoto, K.,
Expression learning and recognition system for a family robot,
CRV04(259-264).
IEEE DOI 0408
BibRef
And:
Learning system of human facial expression for a family robot,
AFGR04(481-486).
IEEE DOI 0411
BibRef

Hong, H., Neven, H., von der Malsburg, C.[Christoph],
Online Facial Expression Recognition Based on Personalized Galleries,
AFGR98(354-359).
IEEE DOI BibRef 9800

Chapter on Face Recognition, Detection, Tracking, Gesture Recognition, Fingerprints, Biometrics continues in
Applied Face Expression Recognition, Specific Expressions .