Capturing social cues with imaging glasses

Lauren Murray; Ross Goutcher; Philip Hands; Juan Ye

doi:10.1145/2968219.2968260

Capturing social cues with imaging glasses

Lauren Murray, Ross Goutcher, Philip Hands, Juan Ye

School of Engineering

Research output: Chapter in Book/Report/Conference proceeding › Chapter (peer-reviewed) › peer-review

Abstract

Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

Original language	English
Title of host publication	UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct
Publisher	ACM
Pages	968-972
ISBN (Print)	978-1-4503-4462-3
DOIs	https://doi.org/10.1145/2968219.2968260
Publication status	Published - 12 Sept 2016
Event	The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2016), colocated with ISWC 2016 - Heidelberg, Germany Duration: 12 Sept 2016 → 16 Sept 2016

Conference

Conference	The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2016), colocated with ISWC 2016
Country/Territory	Germany
City	Heidelberg
Period	12/09/16 → 16/09/16

Access to Document

10.1145/2968219.2968260

UBICOMP-ISWC 2016 (Heidelberg) - Capturing social cues with imaging glassesFinal published version, 1.36 MB

Perceiving pictures through touch: A haptic interface for communicating form
Hands, P. (Co-investigator), Goutcher, R. (Principal Investigator), Ye, J. (Co-investigator), Ceriotti, M. (Co-investigator) & Hart, P. (Other)
4/11/13 → 4/01/15
Project: Research Collaboration with external organisation

Scottish Crucible
Hands, P. J. W. (Recipient), 2 May 2013
Prize: Other distinctions

Cite this

@inbook{894a5f865bf44733bc314bc0785c6440,

title = "Capturing social cues with imaging glasses",

abstract = "Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.",

author = "Lauren Murray and Ross Goutcher and Philip Hands and Juan Ye",

year = "2016",

month = sep,

day = "12",

doi = "10.1145/2968219.2968260",

language = "English",

isbn = "978-1-4503-4462-3",

pages = "968--972",

booktitle = "UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct",

publisher = "ACM",

note = "The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2016), colocated with ISWC 2016 ; Conference date: 12-09-2016 Through 16-09-2016",

}

Murray, L, Goutcher, R, Hands, P & Ye, J 2016, Capturing social cues with imaging glasses. in UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, pp. 968-972, The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2016), colocated with ISWC 2016 , Heidelberg, Germany, 12/09/16. https://doi.org/10.1145/2968219.2968260

TY - CHAP

T1 - Capturing social cues with imaging glasses

AU - Murray, Lauren

AU - Goutcher, Ross

AU - Hands, Philip

AU - Ye, Juan

PY - 2016/9/12

Y1 - 2016/9/12

N2 - Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

AB - Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

U2 - 10.1145/2968219.2968260

DO - 10.1145/2968219.2968260

M3 - Chapter (peer-reviewed)

SN - 978-1-4503-4462-3

SP - 968

EP - 972

BT - UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

PB - ACM

T2 - The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2016), colocated with ISWC 2016

Y2 - 12 September 2016 through 16 September 2016

ER -

Capturing social cues with imaging glasses

Abstract

Conference

Access to Document

Fingerprint

Projects

Perceiving pictures through touch: A haptic interface for communicating form

Prizes

Scottish Crucible

Cite this