The Handbook on Socially Interactive Agents
20 Years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics



Volume 1: Methods, Behavior, Cognition

 


The first volume starts by introducing what is involved in SIAs research, in particular research methodologies and ethical implications of developing SIAs. It further examines research on appearance and behavior, focusing on multimodality. Finally, social cognition for SIAs is investigated using different theoretical models and phenomena such as theory of mind or pro-sociality.


A digital version of volume 1 of the book can be purchased in the ACM digital library: https://doi.org/10.1145/3477322 

The printed version can be purchased in different online bookstores, e.g. Amazon

We are grateful to ACM for allowing us to share the preprints of the chapters.





Chapter 1  Introduction to Socially Interactive Agents  | 1

Birgit Lugrin

Preprint
chapter1_introduction.pdf (3.66MB)
Preprint
chapter1_introduction.pdf (3.66MB)


PART I Establishing SIA Research  | 19

Chapter 2  Empirical Methods in the Social Science for Researching Socially Interactive Agents  |  21

Astrid Rosenthal-von der Pütten and Anna M. H. Abrams



Preprint
chapter2_methods_1.pdf (864.14KB)
Preprint
chapter2_methods_1.pdf (864.14KB)


Chapter 3  Social Reactions to Socially Interactive Agents and Their Ethical Implications  |  77

Nicole Krämer and Arne Manzeschke



Part II Appearance and behavior  |  105

Chapter 4 Appearance  |  107

Rachel McDonnell and Bilge Mutlu



Preprint
chapter4_appearance.pdf (10.92MB)
Preprint
chapter4_appearance.pdf (10.92MB)


Chapter 5 Natural Language Understanding in Socially Interactive Agents  |  147

Roberto Pieraccini



Preprint
chapter5_NLU.pdf (551.28KB)
Preprint
chapter5_NLU.pdf (551.28KB)


Chapter 6 Building and Designing Expressive Speech Synthesis  |  173

Matthew P. Aylett, Leigh Clark, Benjamin R. Cowan, and Ilaria Torre




Chapter 7 Gesture Generation  |  213

Carolyn Saund and Stacy Marsella




Chapter 8 Multimodal Behavior Modeling for Socially Interactive Agents  |  259

Catherine Pelachaud, Carlos Busso, and Dirk Heylen


Part III Social Cognition - Models and Phenomena  |  311

Chapter 9 Theory of Mind and Joint Attention  |  313

Jairo Perez-Osorio, Eva Wiese, and Agnieszka Wykowska



Preprint
chapter9_ToM.pdf (803.74KB)
Preprint
chapter9_ToM.pdf (803.74KB)


Chapter 10 Emotion  |  349

Joost Broekens



Preprint
chapter10_emotion.pdf (471.11KB)
Preprint
chapter10_emotion.pdf (471.11KB)


Chapter 11 Empathy and Prosociality in Social Agents  |  385

Ana Paiva, Filipa Correia, Raquel Oliveira, Fernando Santos, and Patrícia Arriaga




Chapter 12 Rapport Between Humans and Socially Interactive Agents  |  433

Jonathan Gratch and Gale Lucas



Preprint
chapter12_rapport.pdf (1.41MB)
Preprint
chapter12_rapport.pdf (1.41MB)


Chapter 13 Culture for Socially Interactive Agents  |  463

Birgit Lugrin and Matthias Rehm



Preprint
chapter13_culture.pdf (553.01KB)
Preprint
chapter13_culture.pdf (553.01KB)


Authors' Biographies  |  495



Index  |  509