Improving the State of the Art for Training - Human-AI Teams - Technical Report 5 - Individual Differences and Team Qualities to Measure in a Human-AI Teaming Testbed - February 2024

Aug 30, 2026

Technical Report #5 analyzes which individual differences and team qualities should be measured in a human-AI teaming testbed to advance training effectiveness. The report structures construct-level guidance around Big Five personality traits, emotional intelligence, individualism/collectivism orientation, locus of control, and preference for teamwork. It further develops team-level characteristics including teamwork attitudes and perceptions, team efficacy, and team cohesion. It recommends variables and measurement approaches, supported by a set of summary tables for practical assessment in human-AI team evaluations.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages81

Reading Time3 h 24 min

AccessFree to download

BACKGROUND

TRAIT-LEVEL CONSTRUCTS

BIG FIVE PERSONALITY TRAITS

PERSONALITY DIMENSIONS AND TEAMING PERFORMANCE

EMOTIONAL INTELLIGENCE

INDIVIDUALIST AND COLLECTIVIST ORIENTATION

LOCUS OF CONTROL

PREFERENCE FOR TEAMWORK

TEAM CHARACTERISTICS

TEAMWORK ATTITUDES AND PERCEPTIONS

TEAM EFFICACY

TEAM COHESION

OVERALL SUMMARY OF RECOMMENDED VARIABLES AND MEASURES

Improving the State of the Art for Training Human-AI Teams Technical Report \#5 Individual Differences and Team Qualities to Measure in a Human-AI Teaming Testbed February 2024 Lillian Asiala and Jim McCarthy Sonalysts, Inc. This Page Intentionally Blank Table of Contents 1 BACKGROUND ............................................................................................................................................... 1 2 TRAIT-LEVEL CONSTRUCTS............................................................................................................................. 3 2.1 BIG FIVE PERSONALITY TRAITS .............................................................................................................................3 2.1.1 Approaches to Operationalizing Personality Dimensions in Teams .........................................................4 2.1.2 Measuring the Big Five ............................................................................................................................ 4 2.2 PERSONALITY DIMENSIONS AND TEAMING PERFORMANCE ........................................................................................5 2.3 EMOTIONAL INTELLIGENCE ..................................................................................................................................6 2.3.1 Operationalizing Emotional Intelligence ..................................................................................................7 2.3.2 Measuring Emotional Intelligence ...........................................................................................................9 2.4 INDIVIDUALIST AND COLLECTIVIST ORIENTATION ...................................................................................................18 2.4.1 Operationalizing Individualism and Collectivism ................................................................................... 19 2.4.2 Individualism and Collectivism in Teams ................................................................................................ 20 2.4.3 Measuring Individualism and Collectivism ............................................................................................. 21 2.5 LOCUS OF CONTROL.........................................................................................................................................22 2.5.1 Operationalizing Locus of Control ..........................................................................................................23 2.5.2 Measuring LOC in Teams ....................................................................................................................... 25 2.5.3 Measuring Locus of Control ...................................................................................................................26 2.6 PREFERENCE FOR TEAMWORK............................................................................................................................28 2.6.1 Operationalizing Preference for Teamwork ........................................................................................... 29 2.6.2 Measuring Preference for Teamwork ....................................................................................................30 3 TEAM CHARACTERISTICS ............................................................................................................................. 35 3.1 TEAMWORK ATTITUDES AND PERCEPTIONS ..........................................................................................................35 3.1.1 Operationalizing Teamwork Attitudes and Perceptions ........................................................................35 3.1.2 Measuring Attitudes and Perceptions ....................................................................................................39 3.2 TEAM EFFICACY ......................................................................................

FAQs

What constructs does the report recommend measuring at the trait level in a human-AI teaming testbed?

It focuses on Big Five personality traits, emotional intelligence, individualism/collectivism orientation, locus of control, and preference for teamwork. Each construct includes operationalization and measurement guidance.

Which team-level characteristics are covered in the report?

The report covers teamwork attitudes and perceptions, team efficacy, and team cohesion. It includes approaches to operationalize and measure these qualities.

How does the report support recommended variables and measures?

It provides an overall summary of recommended variables and measures and includes tables that summarize measurement sets for the listed constructs.

Aug 30, 2026

Upload by Nguyễn Văn Học