Contextual factors contributing to quality implementation of the PAX good behaviour game in Estonia: the view of experienced coaches

Authors

  • Triin Ulla
  • Katrin Poom-Valickis

DOI:

https://doi.org/10.12697/eha.2023.11.1.06

Keywords:

PAX GBG, implementation quality, contextual factors

Abstract

Sotsiaal-emotsionaalsete pädevuste omandamisest võidavad kaasava hariduse kontekstis väga erinevad õppijad. Eestis on täheldatud ja tõendatud VEPA Käitumisoskuste Mängu mõju laste sotsiaal-emotsionaalsetele pädevustele ja heaolule klassis, kuid pole selge, millistest teguritest sõltub VEPA metoodika rakendamise kvaliteet erinevates koolides ja klassiruumides. Seetõttu oli siinse uurimuse eesmärk välja selgitada kogenud mentorite arusaamad programmi kvaliteetsest kasutamisest ja seda mõjutavatest teguritest. Tulemused võimaldavad pöörata tähelepanu programmi kasutamise võimalikele kitsaskohtadele ja neid teadlikult ennetada. Mentorid kirjeldasid eeskätt rakendamise protsessi tahke ja õpilaste reaktsioone. VEPA programmi kasutamist mõjutavad mentorite hinnangul enim õpetajate omadused, programmi toe struktuur, õpetaja ja mentori koostöösuhe ning programmi kasutajatele antav tagasiside ja ühiskondlik kõlapind.

PDF Summary

Downloads

Download data is not yet available.

References

Allas, R., Leijen, Ä., & Toom, A. (2020). Suunatud refleksiooni protseduuri rakendamise peamised kasutegurid ja kitsaskohad õpetajakoolituse üliõpilaste ja õpetajate hinnangul. Eesti Haridusteaduste Ajakiri, 8(2), 85–110. https://doi.org/10.12697/eha.2020.8.2.04

Baier, F., Decker, A.-T., Voss, T., Kleickmann, T., Klusmann, U., & Kunter, M. (2019). What makes a good teacher? The relative importance of mathematics teachers’ cognitive ability, personality, knowledge, beliefs, and motivation for instructional quality. British Journal of Educational Psychology, 89, 767–786. https://doi.org/10.1111/bjep.12256

Becker, K. D., Bradshaw, C. P., Domitrovich, C., & Ialongo, N. S. (2013). Coaching teachers to improve implementation of the Good Behavior Game. Administration and Policy in Mental Health and Mental Health Services Research, 40, 482–493. https://doi.org/10.1007/s10488-013-0482-8

Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275. https://doi.org/10.1007/s11121-008-0100-2

Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33. https://doi.org/10.1007/s11121-010-0186-1

Bradshaw, C. P., Zmuda, J. H., Kellam S., & Ialongo, N. (2009). Longitudinal impact of two universal preventive interventions in first grade on educational outcomes in high school. Journal of Educational Psychology, 101(4), 926–937. https://doi.org/10.1037/a0016586

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 77–101. https://doi.org/10.1191/1478088706qp063oa

Combs, K. M., Buckley, P. R., Lain, M. A., Drewelow, K. M., Urano, G., & Kerns, S. E. U. (2022). Influence of classroom-level factors on implementation fidelity during scale-up of evidence-based interventions. Prevention Science, 23, 969–981. https://doi.org/10.1007/s11121-022-01375-3

Combs, K. M., Drewelow, K. M., Habesland, M. S. Lain, M. A., & Buddey, P. R. (2021). Does training modality predict fidelity of an evidence-based intervention delivered in schools?. Prevention Science, 22(7), 928–938. https://doi.org/10.1007/s11121-021-01227-6

Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45. https://doi.org/10.1016/S0272-7358(97)00043-3

Devlin, B. L., Paes, T. M., Greer, E., A., Bryant, L. M., Zehner, T. M., Korucu, I., Morse, K., Duncan, R. J., Purpura, D. J., & Schmitt, S. A. (2023). Moving beyond dosage and adherence: A protocoll for capturing dimensions of active child engagement as a measure of fidelity for social-emotional learning interventions. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2022.1014713

Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., Romanelli, L. H., Leaf, P. J., Greenberg, M. T., & Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. https://doi.org/10.1080/1754730X.2008.9715730

Domitrovich, C. E., Pas, E. T., Bradshaw, C. P., Becker, K. D., Keperling, J. P., Embry, D. D., & Ialongo, N. (2015). individual and school organizational factors that influence implementation of the PAX Good Behavior Game intervention. Prevention Science, 16, 1064–1074. https://doi.org/10.1007/s11121-015-0557-8

Domitrovich, C. E., Yibing, L., Mathis, E. T., & Greenberg, M. (2019). Individual and organizational factors associated with teacher self-reported implementation of the PATHS curriculum. Journal of School Pshychology, 76, 168–185. https://doi.org/10.1016/j.jsp.2019.07.015

Dowling, K., & Barry, M. M. (2020). Evaluating the implementation quality of a social and emotional learning program: A mixed methods approach. International Journal of Environmental Research and Public Health, 17, 3249–3265. https://doi.org/10.3390/ijerph17093249

Durlak, J. A. (2015). Studying program implementation is not easy but it is essential. Prevention Science, 16, 1123–1127. https://doi.org/10.1007/s11121-015-0606-3

Durlak, J. A., (2016). Programme implementation in social and emotional learning: basic issues and research findings. Cambridge Journal of Education, 46(3), 333–345. https://doi.org/10.1080/0305764X.2016.1142504

Durlak, J. A., & DuPre, E. (2008). Implementation Matters: a Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation. American Journal of Community Psychology, 41, 327–350. https://doi.org/10.1007/s10464-008-9165-0

Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11(3), 75–113. https://doi.org/10.1007/s10567-008-0036-x

Embry, D., Staatemeier, G., Richardson, C., Lauger, K., & Mitich, J. (2003). The PAX good behavior game (1st edn). Center City, MN: Hazelden.

Farmer, T. W., Sutherland, K. S., Talbott, E., Brooks, D. S., Norwalk, K., & Huneke, M. (2016). Special educators as intervention specialists: Dynamic systems and the complexity of intensifying intervention for students with emotional and behavioral disorders. Journal of Emotional and Behavioral Disorders, 24(3), 173–186. https://doi.org/10.1177/1063426616650166

Gregory, A., Henry, D. B., & Schoeny, M. E. (2007). School climate and implementation of a preventive intervention. American Journal of Community Psychology, 40, 250–260. https://doi.org/10.1007/s10464-007-9142-z

Haridus- ja teadusministeerium (s.a.). Hariduslike erivajadustega õpilaste toetamine: õppekorraldus ja tugiteenused. Õpilaste hariduslike erivajadustega arvestamine õppe korraldamisel ja tugiteenuste kättesaadavuse tagamise. Loetud aadressil: https://www.hm.ee/et/tegevused/hariduslike-erivajadustega-opilaste-toetamine-oppekorraldus-ja-tugiteenused.

Heikonen, L., Pietarinen, J., Pyhältö, K., Toom, A., & Soini, T. (2017). Early career teachers’ sense of professional agency in the classroom: Associations with turnover intentions and perceived inadequacy in teacher–student interaction. Asia-Pacific Journal of Teacher Education, 45(3), 250–266. https://doi.org/10.1080/1359866X.2016.1169505

Humphrey, N., Barlow, A., & Lendrum, A. (2018). Quality matters: Implementation moderates student outcomes in the PATHS curriculum. Prevention Science, 19(2), 197–208. https://doi.org/10.1007/s11121-017-0802-4

Humphrey, N., Panayiotou, M., Hennessey, A., & Ashworth, E. (2021). Treatment effect modifiers in a randomized trial of the good behavior game during middle childhood. Journal of Consulting and Clinical Psychology, 89(8), 668–681. https://doi.org/10.1037/ccp0000673

Kivirand, T., Leijen, Ä., Lepp, L., & Malva, L. (2020). Kaasava hariduse tähendus ja tõhusa rakendamise tegurid Eesti kontekstis: õpetajaid koolitavate või nõustavate spetsialistide vaade. Eesti Haridusteaduste Ajakiri, 8(1), 48–71. https://doi.org/10.12697/eha.2020.8.1.03

Johnson, L. A., Wehby, J. H., Symons, F. J., Moore, T. C., Maggin, D. M., & Sutheland, K.S. (2014). An analysis of preference relative to teacher implementation of intervention. The Journal of Special Education, 48(3), 214–224. https://doi.org/10.1177/0022466913475872

Johnson, S. R., Pas, E. T., Bradshaw, C. P., & Ialongo, N. S. (2018). Promoting teachers’ implementation of classroom-based prevention programming through coaching: The mediating role of the coach-teacher relationship. Administration and Policy in Mental Health and Mental Health Services Research, 45, 404–416. https://doi.org/10.1007/s10488-017-0832-z

Jones, S. M., Brush, K. E., Ramirez, T., Xinyi Mao, Z., Marenus, M., Wettje, S., Finney, K., Raisch, N., Podoloff, N., Kahn, J., Barnes, S., Stickle, L., Brion-Meisels, G., McIntyre, J., Curatas, J., & Bailey, R. (2021). Navigating SEL from the inside out: Looking inside and across 33 leading SEL programs: A practical resource for schools and OST providers. Revised & expanded second edition. (Preschool and elementary focus). New York, NY: The Wallace Foundation.

Jones, S. M., McGarrah, W., & Kahn, J. (2019). Social and emotional learning: A principled science of human development in context. Educational Psychologist 54(3), 129–143. https://doi.org/10.1080/00461520.2019.1625776

Kellam, S., Brown, C. H., Poduska, J., Ialongo, N., Wang, W., Toyinbo, B., Petras, H., Ford, C., Windham, A, & Wilcox, H.C. (2008). Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug & Alcohol Dependence, 95(S1), S5–S28. https://doi.org/10.1016/j.drugalcdep.2008.01.004

Kennedy, B. L. (2018). Deduction, Induction, and Abduction. Kogumikus: U. Flick (toim.) The SAGE handbook of qualitative data collection (lk 49–64). London: SAGE Publications Ltd.

Malloy, M., Acock, A., DuBois, D. L., Vuchinich, S., Silverthorn, N., Ji, P., & Flay, B. R. (2015). Teachers’ perceptions of school organizational climate as predictors of dosage and quality of implementation of a social-emotional and character development program. Prevention Science, 16, 1086–1095. https://doi.org/10.1007/s11121-014-0534-7

McClelland, M. M., Tominey, S. L., Schmitt, S. A., & Duncan, R. (2017). SEL interventions in early childhood. Future of Children 27(1), 33–47. https://doi.org/10.1353/foc.2017.0002

Musci, R. J., Pas, E. T., Bettencourt, A. F., Masyn, K. E., Ialongo, N. S., & Bradshaw, C. P. (2019). How do collective student behavior and other classroom contextual factors relate to teachers’ implementation of an evidence-based intervention? A multilevel structural equation model. Development and Psychopathology, 31, 1827–1835. https://doi.org/10.1017/S095457941900097X

Poom-Valickis, K., & Ulla, T. (2020). Kaasava hariduse rakendamist toetavate hoiakute kujundamine õpetajakoolituse esmaõppes. Eesti Haridusteaduste Ajakiri, 8(1), 72–99. https://doi.org/10.12697/eha.2020.8.1.04

Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and reserch agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. https://doi.org/10.1007/s10488-010-0319-7

Põhikooli- ja gümnaasiumiseadus (2022). Loetud aadressil: https://www.riigiteataja.ee/akt/13332410?leiaKehtiv.

Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38(4), 510–532.

Räis, M.-L., Kallaste, E., & Sandre, S. (2016). Haridusliku erivajadusega õpilaste kaasava hariduskorralduse ja sellega seotud meetmete tõhusus. Uuringu lõppraport. Eesti Rakendusuuringute keskus CENTAR. Loetud aadressil: https://centar.ee/uus/wp-content/uploads/2017/01/Pohiraport-final.pdf.

Räis, M.-L., Sõmer, M. (2016). Haridusliku erivajadusega õpilaste kaasava hariduskorralduse ja sellega seotud meetmete tõhusus Temaatiline raport: kaasamise tähenduslikkus. Eesti Rakendusuuringute keskus CENTAR. Loetud aadressil: http://centar.ee/pdf/ee/2016_Haridusliku_erivajadusega_opilaste_kaasava_hariduskorralduse_ja_sellega_seotud_meetmete_tohusus_kaasamise_tahenduslikkus.pdf.

Ryan, R. M., & Deci, E. L. (2017). Self-determination theory. Basic psychological needs in motivation, development, and wellness. The Guilford Press.

Streimann, K., Selart, A., & Trummal, A. (2020). Effectiveness of a universal, classroom-based preventive intervention (PAX GBG) in Estonia: A cluster-randomized controlled trial. Prevention Science, 21(2), 234–244. https://doi.org/10.1007/s11121-019-01050-0

Zins, J. E., Bloodworth, M. R., Weissberg, R. P., & Walberg, H. (2004). The scientific base linking social and emotional learning to school success. Kogumikus J. E. Zins, R. P. Weissberg, M. C. Wang & H. J. Walberg (toim), Building academic success on social and emotional learning: What does the research say? (lk 3–22). New York: Teachers College Press. https://doi.org/10.1080/10573560600992837

Taimalu, M. (2020). Mida räägib meile TALIS 2018 uuring õpetaja ja koolijuhi karjääriteest? Eesti Haridusteaduste Ajakiri, 8(1), 217–220. https://doi.org/10.12697/eha.2020.8.1.10

Taimalu, M., Uibu, K., Luik, P., Leijen, Ä., & Pedaste, M. (2020). Õpetajad ja koolijuhid väärtustatud professionaalidena. OECD rahvusvahelise õpetamise ja õppimise uuringu TALIS 2018 tulemused. 2. osa. Tallinn: Sihtasutus Innove. Loetud aadressil: https://www.innove.ee/wp-content/uploads/2020/04/TALIS2_kujundatud.pdf.

Trummal, A. (2018). VEPA Käitumisoskuste Mängu tulemused. Õppeaasta 2017/2018. Tallinn: Tervise Arengu Instituut. Loetud aadressil: https://intra.tai.ee//images/prints/documents/155678705865_VEPA_kaitumisoskuste_mangu_tulemused_oppeaasta_2017-2018.pdf.

Trummal, A. (2019). VEPA Käitumisoskuste Mängu tulemused. Õppeaasta 2018/2019. Tallinn: Tervise Arengu Instituut. Loetud aadressil: https://intra.tai.ee//images/prints/documents/156880676628_VEPA_kaitumisoskuste_mangu_tulemused_oppeaasta_2018_2019.pdf.

Ulla, T., & Poom-Valickis, K. (2023). Program support matters: A systematic review on teacher- and school related contextual factors facilitating the implementation of social-emotional learning programs. Frontiers in Education. https://doi.org/10.3389/feduc.2022.965538

VEPA Käitumisoskuste Mäng (s.a.). www.vepa.ee/tutvustus.

Wehby, J. H., Maggin, D. M., Moore Partin, T. C., & Robertson, R. (2012). The impact of working alliance, social validity, and teacher burnout on implementation fidelity of the Good Behavior Game. School Mental Health, 4, 22–33. https://doi.org/10.1007/s12310-011-9067-4

Weissberg, R. P., Durlak, J. A., Domitrovich, C. E., & Gullotta, T. P. (2015). Social and emotional learning: Past, present and future. Kogumikus J. A. Durlak, C. E. Domitrovich, R. P. Weissberg, & T. P. Gullotta (toim), Handbook of social and emotional learning: Research and practice (lk. 3–19). New York, NY: Guilford Press.

Published

2023-05-01

How to Cite

Ulla, T., & Poom-Valickis, K. (2023). Contextual factors contributing to quality implementation of the PAX good behaviour game in Estonia: the view of experienced coaches. Eesti Haridusteaduste Ajakiri. Estonian Journal of Education, 11(1), 130–158. https://doi.org/10.12697/eha.2023.11.1.06

Issue

Section

Articles