Intervention Summary
Kognito At-Risk for College Students
Kognito At-Risk for College Students is a 30-minute, online, interactive training simulation that prepares college students and student leaders, including resident assistants, to provide support to peers who are exhibiting signs of psychological distress such as depression, anxiety, substance abuse, and suicidal ideation. Through a self-paced, narrative-driven experience, participants build knowledge, skills, and confidence to identify, approach, and refer an at-risk student to counseling, mental health, or crisis support services. By practicing speaking with fully animated and emotionally responsive avatars that act and respond like real humans, participants learn effective communication tactics for managing challenging conversations. The course also works to reduce stigma around mental health issues and increase protective factors by promoting help-seeking behaviors and improving social connectedness. Simulations are authored and delivered using Kognito's proprietary Human Interaction Game Engine, which is based on research in social cognition, neuroscience, and motivational interviewing. The course begins with participants engaging in a variety of social encounters with four avatar friends and identifying warning signs in each friend. Once they have selected the friend who is most at risk, participants practice using evidence-based techniques to effectively broach the topic of psychological distress and motivate that friend to seek help at a campus counseling center or health center. They learn to avoid common pitfalls of "gatekeeper" behavior, such as attempting to diagnose the problem or giving unwarranted advice. By providing hands-on practice, the training increases participants' confidence and ability to handle similar challenging situations in real life. Participants are also encouraged to seek counseling for themselves if they are experiencing psychological distress. A local resources button in the course links participants to specific information about counseling and mental health services available on campus and in the surrounding community. Kognito provides At-Risk for College Students under licensing agreements to institutions or statewide agencies. A member of the institution (e.g., counseling center or health center staff) usually serves as an administrator for the course. Program setup requires 1 hour of the administrator's time and is conducted via an online meeting. Depending on the institution's infrastructure, goals, and overall suicide prevention strategy, administrators can expect to spend 2-8 hours per month disseminating and promoting the course to learners. The course is part of a suite of online role-play training simulations offered by Kognito. Other courses are available for higher education faculty, K-12 educators, military families, and medical professionals (see Adaptations section below).
The documents below were reviewed for Quality of Research. The research point of
contact can provide information regarding the studies reviewed and the availability
of additional materials, including those from more recent studies that may have been conducted. Albright, G., Himmel, J., Goldman, R., & Shockley, K. At-Risk for University Students: On-line interactive gatekeeper training simulation for identification and referral of students exhibiting signs of psychological distress. Unpublished manuscript. At-Risk University Student Supporting Document [document created for the NREPP review]
The following populations were identified in the studies reviewed for Quality of
Research.
External reviewers independently evaluate the Quality of Research for an intervention's
reported results using six criteria:
For more information about these criteria and the meaning of the ratings, see Quality of Research.
There is evidence of face validity for all outcome measures and evidence for criterion-related validity for one outcome. The online delivery of the program provides some assurance of fidelity. Missing data and attrition were reported to be low, such that no adjustments were needed. Appropriate statistical methods were used. None of the outcome measures had strong test-retest reliability correlations. A standardized fidelity instrument was not used. Some confounding variables were not adequately addressed, including student's self-selection into the intervention group, the collection of data at different times for the intervention and control groups, and the presence of more freshmen in the control group than in the intervention group.
The materials below were reviewed for Readiness for Dissemination. The implementation
point of contact can provide information regarding implementation of the intervention
and the availability of additional, updated, or new materials. Kognito Interactive. At-Risk for College Students: Implementation manual. Samples of pre- and posttest survey summaries
External reviewers independently evaluate the intervention's Readiness for Dissemination
using three criteria: For more information about these criteria and the meaning of the ratings, see Readiness for Dissemination.
All implementation materials, including the training, are online and accessible 24 hours per day, 7 days per week, to students and administrators. The avatar-based simulation is likely to be engaging to a college audience. A direct link to school-specific referral information is provided in the training through a customized "My Counseling Center" page. Through an administrator account, school staff can access a variety of tools to promote and manage the intervention. An account manager assigned to each implementing site provides an initial orientation by phone as well as ongoing support. Participant surveys are available to assess outcomes, and guidance is provided on how to use the survey data to improve program delivery. Administrators can access user-tracking reports and send automated reminders to participants to increase course completion. No weaknesses were identified by the reviewers.
The cost information below was provided by the developer. Although this cost information
may have been updated by the developer since the time of review, it may not reflect
the current costs or availability of items (including newly developed or discontinued
items). The implementation point of contact can provide current information and
discuss implementation requirements. Descriptive Information
Areas of Interest
Mental health promotion
Outcomes
1: Preparedness to recognize fellow students in psychological distress
2: Preparedness to approach fellow students in psychological distress
3: Preparedness to refer fellow students in psychological distress
4: Likelihood of approaching and referring fellow students exhibiting signs of psychological distress
5: Willingness to seek mental health counseling for self
Outcome Categories
Mental health
Suicide
Ages
18-25 (Young adult)
Genders
Male
Female
Races/Ethnicities
Race/ethnicity unspecified
Settings
Home
School
Geographic Locations
Urban
Suburban
Implementation History
Kognito's At-Risk for College Students was introduced. It has been adopted by more than 120 institutions in 21 States, as well as in the United Kingdom and New Zealand. The course was developed to be appropriate for and acceptable to a broad range of racial and ethnic groups.
NIH Funding/CER Studies
Partially/fully funded by National Institutes of Health: No
Evaluated in comparative effectiveness research studies: No
Adaptations
Kognito At-Risk for College Students is part of a suite of online role-play training simulations that support large-scale, universal mental health promotion and suicide prevention, as well as early intervention of suicidal ideation and mental illness. Each course is developed for a specific group of learners. In addition to At-Risk for College Students, which targets students and student leaders in institutions of higher education, other courses are available for higher education faculty, K-12 educators, military families, and medical professionals.
Adverse Effects
No adverse effects, concerns, or unintended consequences were identified by the developer.
IOM Prevention Categories
Universal
Documents Reviewed
Study 1
Supplementary Materials
Outcomes
Outcome 1: Preparedness to recognize fellow students in psychological distress
Description of Measures
A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How would you rate your preparedness to recognize when a fellow student's behavior or appearance is an indicator of psychological distress such as depression, anxiety, or thoughts of suicide?" Responses were on a 4-point Likert scale from 1 (low) to 4 (very high).
Key Findings
Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in preparedness to recognize fellow students in psychological distress compared with the control group (p < .001).
Studies Measuring Outcome
Study 1
Study Designs
Quasi-experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Outcome 2: Preparedness to approach fellow students in psychological distress
Description of Measures
A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How would you rate your preparedness to approach fellow students exhibiting signs of psychological distress to discuss your concerns?" Responses were on a 4-point Likert scale from 1 (low) to 4 (very high).
Key Findings
Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in student-reported preparedness to approach fellow students in psychological distress compared with the control group (p < .001).
Studies Measuring Outcome
Study 1
Study Designs
Quasi-experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Outcome 3: Preparedness to refer fellow students in psychological distress
Description of Measures
A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How would you rate your preparedness to refer fellow students exhibiting signs of psychological distress to the counseling center?" Responses were on a 4-point Likert scale from 1 (low) to 4 (very high).
Key Findings
Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in preparedness to refer fellow students in psychological distress compared with the control group (p = .029).
Studies Measuring Outcome
Study 1
Study Designs
Quasi-experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Outcome 4: Likelihood of approaching and referring fellow students exhibiting signs of psychological distress
Description of Measures
A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How likely are you to approach and, if necessary, refer a fellow student exhibiting signs of psychological distress to the counseling center?" Responses were on a 4-point Likert scale from 1 (not likely) to 4 (very likely).
Key Findings
Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in likelihood of approaching and referring fellow students exhibiting signs of psychological distress compared with the control group (p < .001).
Studies Measuring Outcome
Study 1
Study Designs
Quasi-experimental
Quality of Research Rating
2.5
(0.0-4.0 scale)
Outcome 5: Willingness to seek mental health counseling for self
Description of Measures
A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "I may seek help from the counseling center myself when feeling stressed." Responses were on a 4-point Likert scale from 1 (strongly disagree) to 4 (strongly agree).
Key Findings
Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in willingness to seek mental health counseling when feeling stressed compared with the control group (p = .047).
Studies Measuring Outcome
Study 1
Study Designs
Quasi-experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Study Populations
Study
Age
Gender
Race/Ethnicity
Study 1
18-25 (Young adult)
51.6% Female
48.4% Male
100% Race/ethnicity unspecified
Quality of Research Ratings by Criteria (0.0-4.0 scale)
Outcome
Reliability
of Measures
Validity
of Measures
Fidelity
Missing
Data/Attrition
Confounding
Variables
Data
Analysis
Overall
Rating
1: Preparedness to recognize fellow students in psychological distress
1.0
2.0
2.0
4.0
1.5
4.0
2.4
2: Preparedness to approach fellow students in psychological distress
1.0
2.0
2.0
4.0
1.5
4.0
2.4
3: Preparedness to refer fellow students in psychological distress
1.0
2.0
2.0
4.0
1.5
4.0
2.4
4: Likelihood of approaching and referring fellow students exhibiting signs of psychological distress
1.0
2.5
2.0
4.0
1.5
4.0
2.5
5: Willingness to seek mental health counseling for self
1.0
2.0
2.0
4.0
1.5
4.0
2.4
Study Strengths
Study Weaknesses
Materials Reviewed
Readiness for Dissemination Ratings by Criteria (0.0-4.0 scale)
Implementation
Materials
Training and Support
Resources
Quality Assurance
Procedures
Overall
Rating
4.0
4.0
4.0
4.0
Dissemination Strengths
Dissemination Weaknesses
Item Description
Cost
Required by Developer
Program license (includes student access to training and administrator access to downloadable implementation manual, promotional materials, usage reports, and participant surveys)
Yes
Consultation and technical assistance by phone or email
Included with license
Yes
Additional Information