vol10 - iss7 - pg6993-7010 - 202608

Q: What sample and group details are used in the analysis?

The document reports N=623 with a gender split of 483/140 and includes year groups 1–4 across 6 tracks, with GPA summarized as mean (SD) 2.98 (0.42).

Q: How do SP and PF compare across the listed competency domains?

For each domain (e.g., critical thinking, digital literacy, emotional intelligence), the Mean Diff (SP-PF) is positive and accompanied by statistically significant results (p < .00), indicating higher SP scores than PF.

Q: Which reliability and agreement statistics support the measurement quality?

It provides ICC(2,1) with 95% confidence intervals and weighted κ with κ confidence intervals for each domain, alongside Cronbach’s alpha for SP and PF item sets.

Sep 2, 2026

Uploaded by Gelato

Study examines how learners’ competency domains differ between two conditions labeled SP and PF, based on a sample size N=623 (483 female, 140 male) across year groups 1–4 and six tracks. Reported domain means, mean differences, 95% confidence intervals, and statistical testing (t, df, p, dz) show consistently significant advantages for SP over PF across critical thinking, communication & collaboration, creativity, information literacy, digital literacy, global/cultural awareness, adaptability & resilience, and emotional intelligence, alongside reliability and construct validity indices (ICC, weighted κ, Cronbach’s alpha, KMO, Bartlett, CFA fit).

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages18

Reading Time45 min

AccessFree to download

Results by competency domain

Reliability and agreement metrics

Factor analysis and model fit

| Characteristic | Value | | --- | --- | | N | 623 | | Gender (F/M) | 483 / 140 | | Year (1–4) | [1, 2, 3, 4] | | Tracks (n) | 6 | | GPA (M, SD) | 2.98 (0.42) | | Domain | SP M | SP
SD | PF
M | PF
SD | Mean Diff (SP-PF) | 95%
CI L | 95%
CI U | t | df | p | dz | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | Critical Thinking | 3.45 | 0.48 | 3.24 | 0.65 | 0.20 | 0.15 | 0.26 | 7.74 | 62 | < .00 | 0.31 | | Communication &
Collaboration | 3.50 | 0.47 | 3.01 | 0.67 | 0.49 | 0.43 | 0.54 | 17.78 | 62 | < .00 | 0.71 | | Creativity | 3.48 | 0.50 | 2.97 | 0.69 | 0.51 | 0.45 | 0.56 | 17.74 | 62 | < .00 | 0.71 | | Information Literacy | 3.38 | 0.53 | 2.98 | 0.66 | 0.40 | 0.34 | 0.45 | 14.47 | 62 | < .00 | 0.58 | | Digital Literacy | 3.51 | 0.52 | 3.05 | 0.62 | 0.46 | 0.40 | 0.51 | 17.37 | 62 | < .00 | 0.69 | | Global/Cultural Awareness | 3.11 | 0.58 | 2.65 | 0.69 | 0.46 | 0.40 | 0.51 | 15.58 | 62 | < .00 | 0.62 | | Adaptability & Resilience | 3.45 | 0.54 | 3.10 | 0.64 | 0.34 | 0.29 | 0.40 | 13.12 | 62 | < .00 | 0.52 | | Emotional Intelligence | 3.51 | 0.51 | 2.96 | 0.71 | 0.55 | 0.50 | 0.61 | 19.02 | 62 | < .00 | 0.76 | | Domain | n | ICC(2,1) | ICC 95% CI L | ICC 95% CI U | Weighted κ | κ 95% CI L | κ 95% CI U | | --- | --- | --- | --- | --- | --- | --- | --- | | Critical Thinking | 124 | 0.872 | 0.794 | 0.930 | 0.871 | 0.801 | 0.933 | | Communication & Collaboration | 124 | 0.849 | 0.765 | 0.915 | 0.848 | 0.758 | 0.910 | | Creativity | 124 | 0.793 | 0.686 | 0.876 | 0.792 | 0.694 | 0.877 | | Information Literacy | 124 | 0.714 | 0.611 | 0.799 | 0.713 | 0.610 | 0.800 | | Digital Literacy | 124 | 0.781 | 0.697 | 0.850 | 0.779 | 0.691 | 0.845 | | Global/Cultural Awareness | 124 | 0.835 | 0.761 | 0.893 | 0.834 | 0.756 | 0.891 | | Adaptability & Resilience | 124 | 0.863 | 0.787 | 0.922 | 0.862 | 0.788 | 0.922 | | Emotional
Intelligence | 124 | 0.880 | 0.822 | 0.928 | 0.879 | 0.822 | 0.924 | | Domain | α (SP items) | α (PF items) | | --- | --- | --- | | Critical Thinking | 0.681 | 0.793 | | Communication & Collaboration | 0.660 | 0.786 | | Creativity | 0.680 | 0.792 | | Information Literacy | 0.734 | 0.769 | | Digital Literacy | 0.718 | 0.745 | | Global/Cultural Awareness | 0.772 | 0.781 | | Adaptability & Resilience | 0.744 | 0.789 | | Emotional Intelligence | 0.701 | 0.821 | | KMO | Bartlett χ²(df) | Bartlett p | Mean h² | Total common variance (Σh² / p) | | --- | --- | --- | --- | --- | | 0.923 | 5828.163 (780) | < .001 | 0.348 | 0.348 | | Item | Information Literacy | Adaptability & Resilience | Global/Cultural Awareness | Critical Thinking | Communication & Collaboration | Emotional
Intelligence | Creativity | Digital
Literacy | h² | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | SP_CT1 | | | | 0.461 | | | | | 0.292 | | SP_CT2 | | | | 0.493 | | | | | 0.324 | | SP_CT3 | | | | 0.411 | | | | | 0.289 | | SP_CT4 | | | | 0.480 | | | | | 0.300 | | SP_CT5 | | | | 0.583 | | | | | 0.380 | | SP_CC1 | | | | | 0.484 | | | | 0.301 | | SP_CC2 | | | | | 0.386 | | | | 0.241 | | SP_CC3 | | | | | 0.551 | | | | 0.333 | | SP_CC4 | | | | | 0.543 | | | | 0.352 | | SP_CC5 | | | | | 0.479 | | | | 0.256 | | SP_CR1 | | | | | | | 0.433 | | 0.272 | | SP_CR2 | | | | | | | 0.370 | | 0.250 | | SP_CR3 | | | | | | | 0.544 | | 0.367 | | SP_CR4 | | | | | | | 0.542 | | 0.387 | | SP_CR5 | | | | | | | 0.456 | | 0.305 | | SP_IL1 | 0.629 | | | | | | | | 0.454 | | SP_IL2 | 0.571 | | | | | | | | 0.379 | | SP_IL3 | 0.540 | | | | | | | | 0.375 | | SP_IL4 | 0.486 | | | | | | | | 0.312 | | SP_IL5 | 0.459 | | | | | | | | 0.316 | | SP_DL1 | | | | | | | | 0.499 | 0.347 | | SP_DL2 | | | | | | | | 0.536 | 0.370 | | SP_DL3 | | | | | | | | 0.471 | 0.340 | | SP_DL4 | | | | | | | | 0.463 | 0.284 | | SP_DL5 | | | | | | | | 0.561 | 0.432 | | S

FAQs

What sample and group details are used in the analysis?

The document reports N=623 with a gender split of 483/140 and includes year groups 1–4 across 6 tracks, with GPA summarized as mean (SD) 2.98 (0.42).

How do SP and PF compare across the listed competency domains?

For each domain (e.g., critical thinking, digital literacy, emotional intelligence), the Mean Diff (SP-PF) is positive and accompanied by statistically significant results (p < .00), indicating higher SP scores than PF.

Which reliability and agreement statistics support the measurement quality?

It provides ICC(2,1) with 95% confidence intervals and weighted κ with κ confidence intervals for each domain, alongside Cronbach’s alpha for SP and PF item sets.

Sep 2, 2026

Uploaded by Gelato