Assessing undergraduate information literacy change over time

Abstract

Purpose The research project assessed information literacy skill changes in college students at two points in time, as entering first-year students in 2012 and as seniors in their senior seminar capstone courses in the 2015–2016 academic year. The paper aims to discuss this issue. Design/methodology/approach The Standardized Assessment of Information Literacy Skills (SAILS) individual test was the selected instrument. Version 1 of the test was used for first-year students and Version 2 was used for seniors. All testing was done in person in computer labs with a librarian or library staff member present to proctor the test. This resulted in obtaining 330 student results as first years and 307 as seniors, with 161 exact matches for both administrations of the test. Exact matching of student scores to demographic details pulled from the college’s student information systems were used in the analysis. Findings The analysis shows that overall first-year students tested below the 70 percent proficiency benchmark in all eight skill sets, but by the time they were seniors they scored above 70 percent in three skill sets. Male students and students of color performed lower than their counterparts, but these groups did demonstrate significant improvement in four skill sets by the time they were seniors. Students in the Honors program, those who took longer to complete the test as seniors, those with higher GPAs, those in Humanities majors, and those who had upper level course exposures to librarian information literacy instruction had higher performance on the test. There were no statistically significant results for students who were first generation, Pell Grant eligible, or were in-state or out-of-state residents. Originality/value There are few published studies that utilized the SAILS test for longitudinal institution-wide assessment. The majority of institutions that utilized the individual version of SAILS did so to determine change within a selected course, or set of courses, in the same semester and very few are published.