How to visualise the unvisible – new video-based eyetracking paradigm "PILK!" for children aged 3 to 4

Authors

  • Helen Saareoja
  • Mari-Liis Kaldoja

DOI:

https://doi.org/10.12697/eha.2021.9.1.08

Keywords:

social competence, social perception, eye gaze technology, assessment, preschool children

Abstract

Sotsiaalselt pädev laps märkab ja tõlgendab eri suhtlusstiimuleid ning suudab nende järgi arvestada oma suhtluspartneriga ja valida sobivad suhtluseesmärgid. Raskused stiimulite märkamisel ja tõlgendamisel võib olla aga üks põhjustest, miks laps käitub mõnes suhtlussituatsioonis ebasobivalt. Sotsiaalset pädevust hindavad hindamisvahendid üldiselt kinnitavad probleemi sotsiaalsetes suhtlusolukordades toimetulemisel, kuid ei anna teavet selle kohta, mis on nimetatud  raskuste põhjus, ega ka selle kohta, kuhu suunata teraapia fookus. Selle tühimiku täitmiseks koostati 2017–2018. aastal 12 originaalvideost koosnev sotsiaalse taju hindamise vahend "PILK!", millega saab hinnata, kuidas laps sõltuvalt  kontekstist fikseerib pilgu olulistele mitteverbaalsetele suhtlussignaalidele (pilgu suund, žestid, emotsioonid, vooruvahetus). Siinne esmauuring näitas, et koostatud hindamisvahendi videotes määratud huvipiirkonnad on suuresti sobilikud hindamaks, kuidas 3–4aastased lapsed pööravad tähelepanu sotsiaalselt olulistele stiimulitele. Uuringu tulemustest selgus, et parema probleemilahenduse oskustega lapsed fikseerisid enam pilku sotsiaalselt olulistele stiimulitele. Pilgu fikseerimise muster sõltus video kontekstist – enam tähelepanu sai inimese nägu, emotsiooni ja reaktsiooni väljendav nägu, tegevus ja sellega kaasnev objekt ning sümboolsed žestid.

PDF Summary

Downloads

Download data is not yet available.

References

Adolphs, R. (2002). Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behavioral and cognitive neuroscience reviews, 1(1), 21–62. https://doi.org/10.1177/1534582302001001003

Beauchamp, M. H., & Anderson, V. (2010). SOCIAL: an integrative framework for the development of social skills. Psychological bulletin, 136(1), 39–63. https://doi.org/10.1037/a0017768

Beauchamp, M. H. (2017). Neuropsychology’s social landscape: Common ground with social neuroscience. Neuropsychology, 31(8), 981–1002. https://doi.org/10.1037/neu0000395

Birmingham, E., & Kingstone, A. (2009). Human social attention: A new look at past, present, and future investigations. Annals of the New York Academy of Sciences, 1156, 118–140. https://doi.org/10.1111/j.1749-6632.2009.04468.x

Bögels, S., & Levinson, S. C. (2017). The Brain Behind the Response: Insights Into Turn-taking in Conversation From Neuroimaging. Research on Language and Social Interaction, 50(1), 71–89. https://doi.org/10.1080/08351813.2017.1262118

Cañigueral, R., & Hamilton, A. F. d. C. (2019). The role of eye gaze during natural social interactions in typical and autistic people. Frontiers in Psychology, 10(MAR), 1–18. https://doi.org/10.3389/fpsyg.2019.00560

Carter, A. S., Briggs-Gowan, M. J., & Davis, N. O. (2004). Assessment of young children’s social-emotional development and psychopathology: Recent advances and recommendations for practice. Journal of Child Psychology and Psychiatry, 45(1), 109–134. https://doi.org/10.1046/j.0021-9630.2003.00316.x

Church, R. B., Garber, P., & Rogalski, K. (2007). The role of gesture in memory and social communication. Gesture, 7(2), 137–158. https://doi.org/10.1075/gest.7.2.02bre

Ciarrochi, J., Chan, A. Y. C., & Bajgar, J. (2001). Measuring emotional intelligence in adolescents. Personality and Individual Differences, 31(7), 1105–1119. https://doi.org/10.1016/S0191-8869(00)00207-5

Crick, N. R., & Dodge, K. A. (1994). A Review and Reformulation of Social Information-Processing Mechanisms in Children’s Social Adjustment. Psychological Bulletin, 115(1), 74–101. https://doi.org/10.1037/0033-2909.115.1.74

Crick, N. R., & Dodge, K. A. (1996). Social Information-Processing Mechanisms in Reactive and Proactive Aggression. Child Development, 67(3), 993–1002. https://doi.org/10.2307/1131875

Crowe, L. M., Beauchamp, M. H., Catroppa, C., & Anderson, V. (2011). Social function assessment tools for children and adolescents: A systematic review from 1988 to 2010. Clinical Psychology Review, 31(5), 767–785. https://doi.org/10.1016/j.cpr.2011.03.008

Denham, S. A., & Burton, R. (1996). A social-emotional intervention for at-risk 4-year-olds. Journal of School psychology, 34(3), 225–245. https://doi.org/10.1016/0022-4405(96)00013-1

Diamond, K. E. (2002). The development of social competence in children with disabilities. Blackwell handbook of childhood social development, 571–587.

Gullberg, M., & Holmqvist, K. (2006). What speakers do and what addressees look at: Visual attention to gestures in human interaction live and on video. Pragmatics and Cognition, 14(1), 53–82. https://doi.org/10.1075/pc.14.1.05gul

Gullberg, M., & Kita, S. (2009). Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behavior, 33(4), 251–277. https://doi.org/10.1007/s10919-009-0073-2

Guralnick, M. J. (1999). Family and child influences on the peer-related social competence of young children with developmental delays. Mental Retardation and Developmental Disabilities Research Reviews, 5(1), 21–29. https://doi.org/10.1002/(SICI)1098-2779(1999)5:1%3C21::AID-MRDD3%3E3.0.CO;2-O

Guralnick, M. J. (2011). Why early intervention works: A systems perspective. Infants and young children, 24(1), 6–28. https://doi.org/10.1097/IYC.0b013e3182002cfe

Hains, S. M. J., & Muir, D. W. (1996). Infant Sensitivity to Adult Eye Direction. Child Development, 67(5), 1940–1951. https://doi.org/10.2307/1131602

Hamiwka, L., Macrodimitris, S., Tellez-Zenteno, J. F., Metcalfe, A., Wiebe, S., Kwon, C. S., Jetté, N., & CASES Investigators. (2011). Social outcomes after temporal or extratemporal epilepsy surgery: a systematic review. Epilepsia, 52(5), 870–879. https://doi.org/10.1111/j.1528-1167.2011.03074.x

Han, H. S., & Kemple, K. M. (2006). Components of social competence and strategies of support: Considering what to teach and how. Early Childhood Education Journal, 34(3), 241–246. https://doi.org/10.1007/s10643-006-0139-2

Hanley, M., Riby, D. M., McCormack, T., Carty, C., Coyle, L., Crozier, N., Robinson, J., & McPhillips, M. (2014). Attention during social interaction in children with autism: Comparison to specific language impairment, typical development, and links to social cognition. Research in Autism Spectrum Disorders, 8(7), 908–924. https://doi.org/10.1016/j.rasd.2014.03.020

Haridus- ja teadusministeerium (2020). Eesti elukestva õppe strateegia 2020.

Harrigan, J. A. (1985). Listeners’ boy movements and speaking turns. Communication Research, 12(2), 233–250. https://doi.org/10.1177/009365085012002004

Ho, S., Foulsham, T., & Kingstone, A. (2015). Speaking and listening with the eyes: Gaze signaling during dyadic interactions. PLoS ONE, 10(8), 1–18. https://doi.org/10.1371/journal.pone.0136905

Hosozawa, M., Tanaka, K., Shimizu, T., Nakano, T., & Kitazawa, S. (2012). How children with specific language impairment view social situations: An eye tracking study. Pediatrics, 129(6), e1453-e1460. https://doi.org/10.1542/peds.2011-2278

Howes, C., & James, J. (2002). Children’s social development within the socialization context of childcare and early childhood education. Blackwell handbook of childhood social development, 137–155.

Häidkind, P., & Oras, K. (2016). Kaasava hariduse mõiste ning õpetaja ees seisvad ülesanded lasteaedades ja esimeses kooliastmes. Eesti Haridusteaduste Ajakiri. Estonian Journal of Education, 4(2), 60–88. https://doi.org/10.12697/eha.2016.4.2.04

Iarocci, G., Yager, J., & Elfers, T. (2007). What gene–environment interactions can tell us about social competence in typical and atypical populations. Brain and Cognition, 65(1), 112–127. https://doi.org/10.1016/j.bandc.2007.01.008

Iverson, J. M., & Goldin-Meadow, S. (2005). Gesture paves the way for language development. Psychological Science, 16(5), 367–371. https://doi.org/10.1111/j.0956-7976.2005.01542.x

Jones, D. E., Greenberg, M., & Crowley, M. (2015). Early social-emotional functioning and public health: The relationship between kindergarten social competence and future wellness. American Journal of Public Health, 105(11), 2283–2290. https://doi.org/10.2105/AJPH.2015.302630

Kaldoja, M. L. (2015). Sotsiaalne pädevus. Teoses E. Kikas & A. Toomela (toim), Õppimine ja õpetamine kolmandas kooliastmes. Üldpädevused ja nende arendamine (lk 185–207).

Kaldoja, M. L., & Kolk, A. (2012). Social-emotional behaviour in infants and toddlers with mild traumatic brain injury. Brain Injury, 26(7–8), 1005–1013. https://doi.org/10.3109/02699052.2012.660516

Krauss, R. M., Morrel-Samuels, P., & Colasante, C. (1991). Do conversational hand gestures communicate?. Journal of Personality and Social Psychology, 61(5), 743–754. https://doi.org/10.1037/0022-3514.61.5.743

Kuhn, G., Tatler, B. W., & Cole, G. G. (2009). You look where I look! Effect of gaze cues on overt and covert attention in misdirection. Visual Cognition, 17(6–7), 925–944. https://doi.org/10.1080/13506280902826775

Kuusk, M. (2018). Väikelaste üldise arengu dünaamiliseks hindamiseks mõeldud "Ages and Stages Qestionnaire 3" kohandamine Eesti oludele. Magistritöö. Tallinna Ülikool, Haridusteaduste instituut.

Langton, S. R., Watt, R. J., & Bruce, V. (2000). Do the eyes have it? Cues to the direction of social attention. Trends in cognitive sciences, 4(2), 50–59. https://doi.org/10.1016/S1364-6613(99)01436-9

Leerkes, E. M., Paradise, M., O’Brien, M., Calkins, S. D., & Lange, G. (2008). Emotion and cognition processes in preschool children. Merrill-Palmer Quarterly, 54(1), 102–124. https://doi.org/10.1353/mpq.2008.0009

Lewis, D. E., Smith, N. A., Spalding, J. L., & Valente, D. L. (2018). Looking behavior and audiovisual speech understanding in children with normal hearing and children with mild bilateral or unilateral hearing Loss. Ear and hearing, 39(4), 783–794. https://doi.org/10.1097/AUD.0000000000000534

Lynch, S. A., & Simpson, C. G. (2010). Social skills: Laying the foundation for success. Dimensions of Early Childhood, 38(2), 3–12.

McDonald, S., Bornhofen, C., Shum, D., Long, E., Saunders, C., & Neulinger, K. (2006). Reliability and validity of The Awareness of Social Inference Test (TASIT): a clinical test of social perception. Disability and Rehabilitation, 28(24), 1529–1542. https://doi.org/10.1080/09638280600646185

McDonald, S. (2012). New frontiers in neuropsychological assessment: Assessing social perception using a standardised instrument, The Awareness of Social Inference Test. Australian Psychologist, 47(1), 39–48. https://doi.org/10.1111/j.1742-9544.2011.00054.x

Montag, C., Dziobek, I., Richter, I. S., Neuhaus, K., Lehmann, A., Sylla, R., Heereken, H. R., Heinz, A., & Gallinat, J. (2011). Different aspects of theory of mind in paranoid schizophrenia: evidence from a video-based assessment. Psychiatry research, 186(2–3), 203–209. https://doi.org/10.1016/j.psychres.2010.09.006

Montgomery, D. E., Back, L. M., & Moran, C. (1998). Children’s use of looking behavior as a cue to detect another’s goal. Child Development, 69(3), 692–705. https://doi.org/10.1111/j.1467-8624.1998.tb06237.x

Mäeots, A. (2018). Sotsiaal-emotsionaalse arengu dünaamiliseks hindamiseks mõeldud Ages and Stages Questionnaire: Social-Emotional 2 kohandamine Eesti oludele. Magistritöö. Tallinna Ülikool, Haridusteaduste instituut.

Nummenmaa, L., Hyönä, J., & Calvo, M. G. (2006). Eye movement assessment of selective attentional capture by emotional pictures. Emotion, 6(2), 257–268. https://doi.org/10.1037/1528-3542.6.2.257

Olk, B., & Kappas, A. (2011). Eye tracking as a tool for visual research. The SAGE Handbook of Visual Research Methods, 433–451. https://doi.org/10.4135/9781446268278.n23

Papagiannopoulou, E. A., Chitty, K. M., Hermens, D. F., Hickie, I. B., & Lagopoulos, J. (2014). A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders. Social Neuroscience, 9(6), 610–632. https://doi.org/10.1080/17470919.2014.934966

Philippot, P., & Feldman, R. S. (1990). Age and social competence in preschoolers’ decoding of facial expression. British Journal of Social Psychology, 29(1), 43–54. https://doi.org/10.1111/j.2044-8309.1990.tb00885.x

Poggi, I., & D’Errico, F. (2011). Social signals: A psychological perspective. In Computer analysis of human behavior (pp. 185–225). Springer, London. https://doi.org/10.1007/978-0-85729-994-9_8

Poulin-Dubois, D., & Forbes, J. N. (2002). Toddlers’ attention to intentions-in-action in learning novel action words. Developmental Psychology, 38(1), 104–114. https://doi.org/10.1037/0012-1649.38.1.104

Raver, C. C. (2002). Emotions matter: Making the case for the role of young children’s emotional development for early school readiness. Social Policy Report, 16(3), 1–20. https://doi.org/10.1002/j.2379-3988.2002.tb00041.x

Rice, K., Moriuchi, J. M., Jones, W., & Klin, A. (2012). Parsing heterogeneity in autism spectrum disorders: Visual scanning of dynamic social scenes in schoolaged children. Journal of the American Academy of Child & Adolescent Psychiatry, 51(3), 238–248. https://doi.org/10.1016/j.jaac.2011.12.017

Spengler, F. B., Scheele, D., Marsh, N., Kofferath, C., Flach, A., Schwarz, S., Stoffel-Wagner, B., Maier, W., & Hurlemann, R. (2017). Oxytocin facilitates reciprocity in social communication. Social Cognitive and Affective Neuroscience, 12(8), 1325–1333. https://doi.org/10.1093/scan/nsx061

Squires, J., Bricker, D., & Potter, L. (2009). Ages and stages questionnaires (ASQ-3). Baltimore, MD: Paul H.

Squires, J., Bricker, D., & Twombly, E. (2015). Ages & Stages questionnaires: Socio-Emotional. Second edition. Baltimore.

Swineford, L. B., Thurm, A., Baird, G., Wetherby, A. M., & Swedo, S. (2014). Social (pragmatic) communication disorder: a research review of this new DSM-5 diagnostic category. Journal of Neurodevelopmental Disorders, 6(1), 41. https://doi.org/10.1186/1866-1955-6-41

Vinciarelli, A., Pantic, M., & Bourlard, H. (2009). Social signal processing: Survey of an emerging domain. Image and vision computing, 27(12), 1743–1759. https://doi.org/10.1016/j.imavis.2008.11.007

Welsh, M., Parke, R. D., Widaman, K., & O’Neil, R. (2001). Linkages between children’s social and academic competence: A longitudinal analysis. Journal of School Psychology, 39(6), 463–482. https://doi.org/10.1016/S0022-4405(01)00084-X

Yu, C., & Smith, L. B. (2013). Joint attention without gaze following: Human infants and their parents coordinate visual attention to objects through eye-hand coordination. PLoS ONE, 8(11), e79659. https://doi.org/10.1371/journal.pone.0079659

Published

2021-05-01

How to Cite

Saareoja, H., & Kaldoja, M.-L. (2021). How to visualise the unvisible – new video-based eyetracking paradigm "PILK!" for children aged 3 to 4. Eesti Haridusteaduste Ajakiri. Estonian Journal of Education, 9(1), 186–218. https://doi.org/10.12697/eha.2021.9.1.08

Issue

Section

Articles