A La Carte Student Survey

A charge from the CISE REU PI community is to work toward a systematic means of collecting and reporting on evaluation data on CISE REU programs, so that the complete and comparable REU story can be told. To this end, we continue to develop survey scales that correspond to the Recommended Indicators (see below). These scales have been designed to measure the Recommended Indicators, which have been found to be common among CISE REU programs. REU PIs are able to select the scales and items as deemed appropriate for your site from the A La Carte Survey menu, with guidelines and instructions provided.  The scales measure the following indicators:

  • self-efficacy
  • intentions to attend graduate school
  • computer science attitudes
  • help-seeking and coping behaviors
  • grit
  • research skills
  • mentoring satisfaction
  • leadership
  • professional/scientist identity formation
  • satisfaction with REU experience

Cross-Walk of A La Carte Themes to Recommended Indicators

A La Carte Survey Themes

Recommended Indicators Categories

Research Experience/Knowledge/ Confidence

Acquire Research Knowledge, Research Communication Skills, Ethics, Computing Knowledge, Self Efficacy, GRIT

Graduate School

Recruitment: Intent to attend graduate school, Attribute future plans to REU

Professional/Skill Development

Acquire Research Knowledge, Research Communication Skills, Ethics, Computing Knowledge, Computing Career Knowledge

Increased Interest in CS Area/Research

Retention: Remain in/change to CISE major, Attribute future plans to REU

Improved Preparedness

Self Efficacy, GRIT

Hands-on Experiences

Attitudes toward REU experiences

Increased Success Rates

Retention: Remain in/change to CISE major, Attribute future plans to REU

Increased Knowledge of Domain 

Domain Knowledge, Domain Career Knowledge

Participant Demographics (gender, ethnicity, major, year in school, etc.)

Demographics

GRIT: This is the original short scale developed by A.L. Duckworth; see

Duckworth, A.L, & Quinn, P.D. (2009). Development and validation of the Short Grit Scale (Grit- S). Journal of Personality Assessment, 91, 166-174. 

Mentoring: This scale was adapted from the Mentorship Effectiveness Scale, developed at Johns Hopkins University and is only used at post survey.

Leadership and Scientific Identity: These scales were adapted from the work of Chemers, Zurbriggen, Syed, Goza, and Bearman (2011). The role of efficacy and identity in science career commitment among underrepresented minority students. Journal of Social Issues, 67, 469-491.

Development of the A La Carte Survey Modules: See: Rorrer, A. (2016). An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice. Evaluation and Program Planning, Volume 55, April 2016, Pages 103-111

Self-Efficacy, Intent towards Graduate School, Coping, Attitudes [2010] - Download the full report from Chris Aberson, Humboldt State here