Advanced SearchSearch Tips
Comparing Initiating and Responding Joint Attention as a Social Learning Mechanism: A Study Using Human-Avatar Head/Hand Interaction
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
  • Journal title : Journal of KIISE
  • Volume 43, Issue 6,  2016, pp.645-652
  • Publisher : Korean Institute of Information Scientists and Engineers
  • DOI : 10.5626/JOK.2016.43.6.645
 Title & Authors
Comparing Initiating and Responding Joint Attention as a Social Learning Mechanism: A Study Using Human-Avatar Head/Hand Interaction
Kim, Mingyu; Kim, So-Yeon; Kim, Kwanguk;
Joint Attention (JA) has been known to play a key role in human social learning. However, relative impact of different interaction types has yet to be rigorously examined because of limitation of existing methodologies to simulate human-to-human interaction. In the present study, we designed a new JA paradigm with emulating human-avatar interaction and virtual reality technologies, and tested the paradigm in two experiments with healthy adults. Our results indicated that initiating JA (IJA) condition was more effective than responding JA (RJA) condition for social learning in both head and hand interactions. Moreover, the hand interaction involved better information processing than the head interaction. The implication of the results, the validity of the new paradigm, and limitations of this study were discussed.
human-computer interaction;human-avatar interaction;joint attention;recognition memory;head-tracking;hand-tracking;
 Cited by
A. Bandura, Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, Vol. 84, No. 2, pp. 191-215, 1977. crossref(new window)

C. Kasari, T. Paparella, S. Freeman, L. B. Jahromi, Language outcome in autism: randomized comparison of joint attention and play interventions. J Consult Clin Psychol, Vol. 76, No. 1, pp. 125, 2008. crossref(new window)

P. Mundy, L. Sullivan, and A. Master george, A parallel and distributed processing model of joint attention and autism. Autism Res., Vol. 2, No. 1, pp. 2-21, 2009. crossref(new window)

M. Tomasello, and M. Carpenter, The emergence of social cognition in three young chimpanzees. Monogr. Soc. Res. ChildDev. Vol. 70, pp. 1-136, 2005. crossref(new window)

M. Tomasello, M. Carpenter, J. Call, T. Behne, and H. Moll, Understanding sharing intentions: the origins of cultural cognition. Behav. BrainSci. Vol. 28, No. 5, pp. 675-691, 2005.

S. P. Vecera, and M. H. Johnson, Gaze detection and the cortical processing of faces: Evidence from infants and adults. Visual Cognition, Vol. 2, No. 1, pp. 59-87, 1995. crossref(new window)

P. Mundy, J. Block, C. Delqado, Y. Pomares, A. V. Van Hecke, and M. V. Parlade, Individual differences and the development of joint attention in infancy, Child Dev, Vol. 78, No. 3, pp. 938-954, 2007. crossref(new window)

S. E. Miller and S. Marcovitch, Examining executive function in the second year of life: coherence, stability, and relations to joint attention and language, Dev Psychol, Vol. 51, No. 1, pp. 101-14, 2015. crossref(new window)

A. P. Bayliss, M. A. Paul, P. R. Cannon, and S. P. Tipper, Gaze cuing and affective judgments of objects: I like what you look at, Psychonomic Bulletin & Review, Vol. 13, No. 6, pp. 1061-1066, 2006. crossref(new window)

A. Frischen, A. P. Bayliss, and S. P. Tipper, Gaze cuing of attention: visual attention, social cognition, and individual differences, Psychol Bull, Vol. 133, No. 4, pp. 694, 2007. crossref(new window)

A. P. Bayliss, A. Frischen, M. J. Fenske, and S. P. Tipper, Affective evaluations of objects are influenced by observed gaze direction and emotional expression, Cognition, Vol. 104, No. 3, pp. 644-653, 2007. crossref(new window)

F. Capozzi, A. P. Bayliss, M. R. Elena, and C. Becchio, One is not enough: Group size modulates social gaze-induced object desirability effects, Psychon Bull Rev. Vol. 22, No. 3, pp. 850-855, 2015. crossref(new window)

J. M. Seibert, A. E. Hogan, and P. C. Mundy, Assessing interactional competencies: the early social communication scales. Infant Ment. HealthJ. Vol. 3, No. 4, pp. 244-258, 1982. crossref(new window)

R. MacDonald, J. Anderson, W. V. Dude, A. Geckeler, G. Green, W. Holcomb, R. Mansfield, and J. Sanchez, Behavioral assessment of joint attention: A methodological report, Research in Developmental Disabilities, Vol. 27, No. 2, pp. 138-150, 2006. crossref(new window)

P. Mundy, M. Sigman, and C. Kasari, Joint attention, developmental level, and symptom presentation in young children with autism, Development and Psychopathology, Vol. 6, No. 3, pp. 389-401, 1994. crossref(new window)

C. Whalen and L. Schreibman, Joint attention training for children with autism using behavior modification procedures, Journal of Child Psychology and Psychiatry, Vol. 44, No. 3, pp. 456-469, 2003. crossref(new window)

W. Jarrold, P. Mundy, M. Gwaltney, J. Bailenson, N. Hatt, N, McIntyre, K. Kim, M. Solomon, S. Novotny, and L. Swain, Social Attention in a Virtual Public Speaking Task in Higher Functioning Children With Autism, Autism Res, Vol. 6, No. 5, pp. 393-410, 2013. crossref(new window)

K. Kim, M. Z. Rosenthal, M. Gwaltney, W. Jarrold, N. Hatt, N. McIntyre, L. Swain, M. Solomon, and P. Mundy, A Virtual Joy-Stick Study of Emotional Responses and Social Motivation in Children with Autism Spectrum Disorder, J Autism Dev Disord, Vol. 45, No. 12, pp. 3891-3899, 2014.

J. B. Grossman, A. Klin, A. S. Carter, and F. R. Volkmar, Verbal bias in recognition of facial emotions in children with Asperger syndrome, Journal of Child Psychology and Psychilatry, Vol. 41, No. 3, pp. 369-379, 2000. crossref(new window)

M. B. Harms, A. Martin, and G. L. Wallace, Facial emotion recognition in autism spectrum disorders: A review of behavioral and neuroimaging studies, Neuropsychology Review, Vol. 20, No. 3, pp. 290-322, 2010. crossref(new window)

J. L. Tracy, R. W. Robins, R. A. Schiriber, and M. Solomon, Is Emotion Recognition Impaired in Individuals with Autism Spectrum Disorders? Journal of Autism and Developmental Disorders, Vol. 41, No. 1, pp. 102-109, 2011. crossref(new window)

K. Kim, P. Mundy, Joint attention, social-cognition, and recognition memory in adults, Front Hum Neurosci, Vol. 6, 2012.

K. M. Stanney, Handbook of Virtual Environments: Design, Implementation and applications, Lawrence Erlbaum Associates, Mahwah, NJ, 2002.

H. G. Weller, Assessing the impact of computer-based learning on science, Journal of Research in Computing in Education, Vol. 28, No. 4, pp. 461-485, 1996. crossref(new window)

J. Diemer, G. W. Alpers, H. M. Peperkorn, Y. Shiban, and A. Muhlberger, The impact of Perception and presence on emotional reaction: a review of research in virtual reality, Front. Psychol., Vol. 6, 2015.

J. Rampling, A. O'Brien, K. Hindhaugh, L. Woodhan, and S. Kavia, Use of an online virtual environment in psychiatric problembased learning, Psychiatrist, Vol. 36, No. 10, pp. 391-396, 2012. crossref(new window)

Jin SA and Park N, Parasocial interaction with my avatar: effects of interdependent self-construal and the mediating role of self-presence in an avatarbased console game, Wii, Cyberpsychol Behav, Vol. 12, No. 6, pp. 723-727, 2009. crossref(new window)

D. Sheslow, and W. Adams, Wide Range Assessment of Memory and Learning Second Edition Administration and Technical Manual. Lutz, FL: Psychological Assessment Resources, 2003.

H. Stanislaw, and N. Todorov, Calculation of signal detection theory. Behav. Res. Methods Instrum. Comput. Vol. 31, No. 1, pp. 137-149, 1999. crossref(new window)

K. P. Schulz, J. Fan, O. Magidina, D. J. Marks, B. Hahn, and J. M. Halperin, Does the emotional go/no-go task really measure behavioral inhibition? Convergence with measures of a non-emotional analog. Arch. Clin. Neuropsychol. Vol. 22, No. 2, pp. 151-160, 2007. crossref(new window)

L. Vygotsky, Interaction between learning and development. In Mind and Society, Cambridge, Mass.: Harvard University Press, 1978.

R. Bakeman and L. B. Adamson, Coordinating attention to people and objects in mother-infant and peerinfant interaction, Child Dev, Vol. 55, No. 4, pp. 1278-1289, 1984. crossref(new window)

A. P. Bayliss, D. Griffiths, and S. P. Tipper, Predictive gaze cues affect face evaluations: The effect of facial emotion, Eur J Cogn Psychol, Vol. 21, No. 7, pp. 1072-1084, 2009. crossref(new window)

G. Butterworth, Pointing is the royal road to language for babies, Pointing: where language, culture, and cognition meet. pp. 9-33.

B. A. Sibley and J. L. Etnier, The relationship between physical activity and cognition in children: a meta-analysis, Pediatric Exercise Science, Vol. 15, No. 3, pp. 243-256, 2003. crossref(new window)

R. Ruscheweyh, C. Willemer, K. Kuger, T. Duning, T. Warnecke, J. Sommer, K. Volker, H. V. Ho, F. Mooren, S. Knecht, and A. Floel, Physical activity and memory functions: An interventional study, Neurobiology of Aging, Vol. 32, No. 7, pp. 1304-1319, 2011. crossref(new window)