The relationship between subjective outcome evaluation and objective outcome evaluation findings: evidence from China

Daniel T.L. Shek; Xiao Yan Han

doi:10.1515/ijdhd-2014-0347

Article

The relationship between subjective outcome evaluation and objective outcome evaluation findings: evidence from China

Daniel T.L. Shek and Xiao Yan Han

Published/Copyright: July 19, 2014

Published by

Become an author with De Gruyter Brill

Author Information Explore this Subject

From the journal International Journal on Disability and Human Development Volume 13 Issue 4

Abstract

The relationships between subjective outcome evaluation and objective subjective evaluation measures were examined in this study. In a positive youth development program (Tin Ka Ping P.A.T.H.S. Project), 1083 high school students responded to objective outcome measures, including the Chinese Positive Youth Development Scale (CPYDS) and measures of thriving and life satisfaction at posttest. The respondents also responded to the Chinese Subjective Outcome Scale (CSOS) at posttest. Results showed that different measures derived from the CSOS (lessons, subject, sharing and benefits) had significant relationships with different measures of the CPYDS, thriving and life satisfaction. The different dimensions of the CSOS scores also predicted different objective outcome measures. The present findings provide additional evidence supporting the linkages between objective outcome and subjective outcome measures.

Keywords: Chinese adolescents; objective outcome evaluation; subjective outcome evaluation; Tin Ka Ping P.A.T.H.S. Project

Corresponding author: Professor Daniel T.L. Shek, PhD, FHKPS, BBS, SBS, JP, Chair Professor of Applied Social Sciences, The Hong Kong Polytechnic University, Room HJ407, Core H, Hung Hom, Hong Kong, P.R. China, E-mail: daniel.shek@polyu.edu.hk; Centre for Innovative Programmes for Adolescents and Families, The Hong Kong Polytechnic University, Hong Kong, P.R. China; Kiang Wu Nursing College of Macau, Macau, P.R. China; Department of Social Work, East China Normal University, Shanghai, P.R. China; and Division of Adolescent Medicine, Department of Pediatrics, Kentucky Children’s Hospital, University of Kentucky College of Medicine, Lexington, KY, USA

Acknowledgments

The preparation for this paper and the Tin Ka Ping East China P.A.T.H.S. Project were financially supported by the Tin Ka Ping Foundation.

References

1. Liu XC, Ma DD, Kurita H, Tang MQ. Self-reported depressive symptoms among Chinese adolescents. Soc Psychiatry Psychiatr Epidemiol 1999;34:44–7.10.1007/s001270050110Search in Google Scholar

2. Hesketh T, Ding QJ, Jenkins R. Suicide ideation in Chinese adolescents. Soc Psychiatry Psychiatr Epidemiol 2002;37:230–5.10.1007/s00127-002-0536-9Search in Google Scholar

3. Chan KL. Victimization and poly-victimization among school-aged Chinese adolescents: prevalence and associations with health. Prev Med 2013;56:207–10.10.1016/j.ypmed.2012.12.018Search in Google Scholar

4. Liang P. What can we learn from China’s college murders? Available at: http://www.theatlantic.com/china/archive/2013/04/what-can-we-learn-from-chinas-college-murders/275256/ (accessed 15 Feb 2013).10.12968/eyed.2013.15.8.iiSearch in Google Scholar

5. Catalano RF, Fagan AA, Gavin LE, Greenberg MT, Irwin CE, Ross DA, et al. Worldwide application of prevention science in adolescent health. Lancet 2012;379:1653–64.10.1016/S0140-6736(12)60238-4Search in Google Scholar

6. Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The impact of enhancing students’ social and emotional learning: a meta-analysis of school-based universal interventions. Child Dev 2011;82:405–2.10.1111/j.1467-8624.2010.01564.xSearch in Google Scholar PubMed

7. Shek DT, Yu L. A review of validated youth prevention and positive youth development programs in Asia. Int J Adolesc Med Health 2011;23:317–24.Search in Google Scholar

8. Shek DT, Ma CM. Impact of the Project P.A.T.H.S. in the junior secondary school years: objective outcome evaluation based on eight waves of longitudinal data. ScientificWorldJ 2012, article ID 170345, 12 pages; doi: 10.1100/2012/170345.10.1100/2012/170345Search in Google Scholar PubMed PubMed Central

9. Shek DT, Yu L. Longitudinal impact of the Project P.A.T.H.S. on adolescent risk behavior: what happened after five years? ScientificWorldJ 2012, article ID 316029, 13 pages; doi: 10.1100/2012/316029.10.1100/2012/316029Search in Google Scholar PubMed PubMed Central

10. Shek DT, Sun RC. Participants’ evaluation of the Project P.A.T.H.S.: are findings based on different datasets consistent? ScientificWorldJ 2012, article ID 187450, 9 pages; doi: 10.1100/2012/187450.10.1100/2012/187450Search in Google Scholar PubMed PubMed Central

11. Shek DT, Ma CM. Program implementers’ evaluation of the Project P.A.T.H.S.: findings based on different datasets over time. ScientificWorldJ 2012, article ID 918437, 10 pages; doi: 10.1100/2012/918437.10.1100/2012/918437Search in Google Scholar PubMed PubMed Central

12. Shek DT. Secondary data analyses of subjective outcome evaluation data based on nine databases. ScientificWorldJ 2012, article ID 346369, 10 pages; doi: 10.1100/2012/346369.10.1100/2012/346369Search in Google Scholar PubMed PubMed Central

13. Shek DT, Yu L. Confirmatory factor analysis using AMOS: a demonstration. Int J Disabil Hum Dev 2014;13:191–204.Search in Google Scholar

14. Shek DT, Ma CM. The use of confirmatory factor analyses in adolescent research: Project P.A.T.H.S. in Hong Kong. Int J Disabil Hum Dev 2014;13:217–26.Search in Google Scholar

15. Shek DT, Ma HK, editors. P.A.T.H.S. to adulthood: a Jockey Club Youth Enhancement Scheme: conceptual framework and curriculum development 1 & 2. Shanghai: Academia Press, 2007 (in Chinese).Search in Google Scholar

16. Lau PS, Han XY, editors. P.A.T.H.S. to adulthood: a Jockey Club Youth Enhancement Scheme: conceptual framework and curriculum development 1: background, concept and design. Shanghai: Academia Press, 2007 (in Chinese).Search in Google Scholar

17. Lee TY, Han XY, editors. P.A.T.H.S. to adulthood: a Jockey Club Youth Enhancement Scheme: conceptual framework and curriculum development 2: youth positive development constructs. Shanghai: Academia Press, 2007 (in Chinese).Search in Google Scholar

18. Shek DT, Han XY, Ma HK, editors. Experiences of joining the positive youth development program: narratives from Shanghai and Hong Kong. Shanghai: Academia Press, 2009 (in Chinese).Search in Google Scholar

19. Shek DT, Yu L, Sun RC, Lee TY, Han XY, Li XX, et al. Objective outcome evaluation of a positive youth development program in China. Int J Disabil Hum Dev 2014;13:255–65.10.1515/ijdhd-2014-0311Search in Google Scholar

20. Shek DT, Han XY, Lee TY, Yu L. Subjective outcome evaluation of a positive youth development program in China. Int J Disabil Hum Dev 2014;13:275–83.10.1515/ijdhd-2014-0313Search in Google Scholar

21. Shek DT, Han XY, Yu L. Impact of Project P.A.T.H.S. in China. In: Shek DT, Sun RC, editors. Development and evaluation of Positive Adolescent Training through Holistic Social Programs (P.A.T.H.S.). Berlin: Springer, 2013.Search in Google Scholar

22. Shek DT. Subjective outcome and objective outcome evaluation findings: insights from a Chinese context. Res Soc Work Pract 2010;20:293–301.10.1177/1049731509331951Search in Google Scholar

23. Walsh T, Lord B. Client satisfaction and empowerment through social work intervention. Soc Work Health Care 2004;38:37–56.10.1300/J010v38n04_03Search in Google Scholar PubMed

24. Trotter C. What does client satisfaction tell us about effectiveness? Child Abuse Rev 2008;17:262–74.10.1002/car.1038Search in Google Scholar

25. Shek DT, Siu A, Lee TY. The Chinese Positive Youth Development Scale: a validation study. Res Soc Work Pract 2007;17:380–91.10.1177/1049731506296196Search in Google Scholar

26. Shek DT, Ma CM. Dimensionality of the Chinese Positive Youth Development Scale: confirmatory factor analyses. Soc Ind Res 2010;98:41–59.10.1007/s11205-009-9515-9Search in Google Scholar

27. Lerner RM, Dowling EM, Anderson PM. Positive youth development: thriving as the basis of personhood and civil society. Appl Dev Sci 2003;7:172–80.10.1207/S1532480XADS0703_8Search in Google Scholar

28. Search Institute. Search Institute profiles of student life: attitudes and behavior. Minneapolis, MN: Search Institute, 2009. Available at: http://www.search-institute.org (accessed 10 June 2012).Search in Google Scholar

29. Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess 1985;49:71–5.10.1207/s15327752jpa4901_13Search in Google Scholar PubMed

30. Sun RC, Shek DT. Life satisfaction, positive youth development, and problem behaviour among Chinese adolescents in Hong Kong. Soc Ind Res 2010;95:455–74.10.1007/s11205-009-9531-9Search in Google Scholar PubMed PubMed Central

31. Damon W. What is positive youth development? Ann Am Acad Polit Soc Sci 2004;591:13–24.10.1177/0002716203260092Search in Google Scholar

32. Sun RC, Shek DT. Positive youth development, life satisfaction and problem behaviour among Chinese adolescents in Hong Kong: a replication. Soc Ind Res 2012;105:541–59.10.1007/s11205-011-9786-9Search in Google Scholar PubMed PubMed Central

33. Weinbach RW. Evaluating social work services and programs. Boston: Allyn and Bacon, 2005.Search in Google Scholar

34. LaSala MC. Client satisfaction: consideration of correlates and response bias. Fam Soc 1997;78:54–64.10.1606/1044-3894.737Search in Google Scholar

35. Shek DT, Lee TY, Siu A, Ma HK. Convergence of subjective outcome and objective outcome evaluation findings: insights based on the Project P.A.T.H.S. ScientificWorldJ 2007;7:258–67.10.1100/tsw.2007.59Search in Google Scholar PubMed PubMed Central

36. Vandiver V, Jordan C, Keopraseuth K, Yu M. Family empowerment and service satisfaction: an exploratory study of Laotian families who care for a family member with mental illness. Psychiatr Rehabil J 1995;19:47–55.10.1037/h0095460Search in Google Scholar

37. Abrams P, Artibani W, Gajewski JB, Hussain I. Assessment of treatment outcomes in patients with overactive bladder: importance of objective and subjective measures. Urology 2006;68:17–28.10.1016/j.urology.2006.05.044Search in Google Scholar PubMed

38. Chiu CY, Yang CF. Chinese subjects’ dilemmas: humility and cognitive laziness as problem in using rating scales. Bull Hong Kong Psychol Soc 1987;18:39–50.Search in Google Scholar

Received: 2013-8-16

Accepted: 2013-9-12

Published Online: 2014-7-19

Published in Print: 2014-11-1

You are currently not able to access this content.

Articles in the same Issue

https://doi.org/10.1515/ijdhd-2014-0347

Keywords for this article

Chinese adolescents; objective outcome evaluation; subjective outcome evaluation; Tin Ka Ping P.A.T.H.S. Project