Emotion Transfer for Hand Animation

Ana-Sabina Irimia; Jacky C. P. Chan; Kamlesh Mistry; Wei Wei; Edmond S. L. Ho

doi:10.1145/3359566.3364692

Emotion Transfer for Hand Animation

Ana-Sabina Irimia, Jacky C. P. Chan, Kamlesh Mistry, Wei Wei, Edmond S. L. Ho

Computer Information Sciences Department

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

35 Downloads (Pure)

Abstract

We propose a new data-driven framework for synthesizing hand motion at different emotion levels. Specifically, we first capture high-quality hand motion using VR gloves. The hand motion data is then annotated with the emotion type and a latent space is constructed from the motions to facilitate the motion synthesis process. By interpolating the latent representation of the hand motion, new hand animation with different levels of emotion strength can be generated. Experimental results show that our framework can produce smooth and consistent hand motions at an interactive rate.

Original language	English
Title of host publication	Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games
Subtitle of host publication	Newcastle upon Tyne, England, October 28-30, 2019
Editors	Hubert P. H. Shum, Edmond S. L. Ho, Marie-Paule Cani, Tiberiu Popa, Daniel Holden, He Wang
Place of Publication	New York
Publisher	ACM
ISBN (Electronic)	9781450369947
DOIs	https://doi.org/10.1145/3359566.3364692
Publication status	Published - 28 Oct 2019
Event	MIG 2019: 12th annual ACM/SIGGRAPH conference on Motion, Interaction and Games - Northumbria University, Newcastle upon Tyne, United Kingdom Duration: 28 Oct 2019 → 30 Oct 2019 http://www.mig2019.website/index.html

Conference

Conference	MIG 2019
Country/Territory	United Kingdom
City	Newcastle upon Tyne
Period	28/10/19 → 30/10/19
Internet address	http://www.mig2019.website/index.html

Keywords

hand animation
emotion
motion capture
style transfer

Access to Document

10.1145/3359566.3364692

Irimia et al - Emotion Transfer for Hand Animation AAMAccepted author manuscript, 6.42 MB

Cite this

Irimia, A-S., Chan, J. C. P., Mistry, K., Wei, W., & Ho, E. S. L. (2019). Emotion Transfer for Hand Animation. In H. P. H. Shum, E. S. L. Ho, M-P. Cani, T. Popa, D. Holden, & H. Wang (Eds.), Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games: Newcastle upon Tyne, England, October 28-30, 2019 Article 41 ACM. https://doi.org/10.1145/3359566.3364692

@inproceedings{9d94eff840cc4ff99a6f70d5dab4d74f,

title = "Emotion Transfer for Hand Animation",

abstract = "We propose a new data-driven framework for synthesizing hand motion at different emotion levels. Specifically, we first capture high-quality hand motion using VR gloves. The hand motion data is then annotated with the emotion type and a latent space is constructed from the motions to facilitate the motion synthesis process. By interpolating the latent representation of the hand motion, new hand animation with different levels of emotion strength can be generated. Experimental results show that our framework can produce smooth and consistent hand motions at an interactive rate.",

keywords = "hand animation, emotion, motion capture, style transfer",

author = "Ana-Sabina Irimia and Chan, {Jacky C. P.} and Kamlesh Mistry and Wei Wei and Ho, {Edmond S. L.}",

year = "2019",

month = oct,

day = "28",

doi = "10.1145/3359566.3364692",

language = "English",

editor = "Shum, {Hubert P. H.} and Ho, {Edmond S. L.} and Marie-Paule Cani and Tiberiu Popa and Daniel Holden and He Wang",

booktitle = "Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games",

publisher = "ACM",

address = "United States",

note = "MIG 2019 : 12th annual ACM/SIGGRAPH conference on Motion, Interaction and Games ; Conference date: 28-10-2019 Through 30-10-2019",

url = "http://www.mig2019.website/index.html",

}

Irimia, A-S, Chan, JCP, Mistry, K, Wei, W & Ho, ESL 2019, Emotion Transfer for Hand Animation. in HPH Shum, ESL Ho, M-P Cani, T Popa, D Holden & H Wang (eds), Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games: Newcastle upon Tyne, England, October 28-30, 2019., 41, ACM, New York, MIG 2019, Newcastle upon Tyne, United Kingdom, 28/10/19. https://doi.org/10.1145/3359566.3364692

Emotion Transfer for Hand Animation. / Irimia, Ana-Sabina; Chan, Jacky C. P.; Mistry, Kamlesh et al.
Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games: Newcastle upon Tyne, England, October 28-30, 2019. ed. / Hubert P. H. Shum; Edmond S. L. Ho; Marie-Paule Cani; Tiberiu Popa; Daniel Holden; He Wang. New York: ACM, 2019. 41.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Emotion Transfer for Hand Animation

AU - Irimia, Ana-Sabina

AU - Chan, Jacky C. P.

AU - Mistry, Kamlesh

AU - Wei, Wei

AU - Ho, Edmond S. L.

PY - 2019/10/28

Y1 - 2019/10/28

N2 - We propose a new data-driven framework for synthesizing hand motion at different emotion levels. Specifically, we first capture high-quality hand motion using VR gloves. The hand motion data is then annotated with the emotion type and a latent space is constructed from the motions to facilitate the motion synthesis process. By interpolating the latent representation of the hand motion, new hand animation with different levels of emotion strength can be generated. Experimental results show that our framework can produce smooth and consistent hand motions at an interactive rate.

AB - We propose a new data-driven framework for synthesizing hand motion at different emotion levels. Specifically, we first capture high-quality hand motion using VR gloves. The hand motion data is then annotated with the emotion type and a latent space is constructed from the motions to facilitate the motion synthesis process. By interpolating the latent representation of the hand motion, new hand animation with different levels of emotion strength can be generated. Experimental results show that our framework can produce smooth and consistent hand motions at an interactive rate.

KW - hand animation

KW - emotion

KW - motion capture

KW - style transfer

U2 - 10.1145/3359566.3364692

DO - 10.1145/3359566.3364692

M3 - Conference contribution

BT - Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games

A2 - Shum, Hubert P. H.

A2 - Ho, Edmond S. L.

A2 - Cani, Marie-Paule

A2 - Popa, Tiberiu

A2 - Holden, Daniel

A2 - Wang, He

PB - ACM

CY - New York

T2 - MIG 2019

Y2 - 28 October 2019 through 30 October 2019

ER -

Emotion Transfer for Hand Animation

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this