The Assessment Committee at Temple University Libraries has been active now for almost six months. I’d like to update you on what the Committee has been doing since Joe Lucia charged this group with “providing advice, support, and the development of projects and initiatives related to measuring, evaluation, and the demonstration of value across all areas of the TUL enterprise.” It’s a big charge and a big group, with members from all units of the Libraries including Law, Ambler, Blockson, SCRC, Paley, SEL and Health Sciences/Podiatry.
One of our first orders of business was to conduct a “data audit” – identifying the (mostly) quantitative data that is currently being collected on a routine basis throughout the Libraries. The great thing is that we’re all collecting data, and lots of it. From statistics on electronic journal usage to interlibrary loans to use of library computer workstations to gate counts to feedback from instruction sessions to library web site traffic – the list goes on and on.
But unsurprisingly, these data sets are stored in different areas, neither centralized nor widely accessible. Similar data, like reference transactions, are collected in various ways – data entry via the web, manual record keeping, spreadsheets. The Assessment Committee is reviewing this environment with an eye towards making data collection, storage and access more standardized, systematic and easy to do.
We’ve engaged in several brainstorming or “visioning” sessions in which we work in small groups to address big questions:
- If we had no restrictions on money or time, what would a library data repository look like and what would it do?
- If we could know anything about our patrons and their use of the library, what would we want to know?
We’ve also explored the question of what metrics and assessment methods need to be in place to evaluate our effectiveness as an organization – using the strategic actions document as a starting place. This is a tough one. It’s easy to count circulation, but much harder to measure our impact on faculty awareness of new methods for scholarly communication.
As for actual assessment taking place, we’re piloting two patron surveys this month. A customer satisfaction survey is helping us learn how patrons perceive our service at public desks. The second survey is a follow-up to research consultations, in which patrons are sent and online survey one week after meeting with a librarian. This is to learn if students are retaining the research skills used during the consultation.
Upcoming blog posts will profile additional assessment underway here at Temple, including:
- SEL’s focus group session with engineering students to learn how the Library contributes to their success here at Temple
- Caitlin Shanley’s ACRL Assessment in Action project on the effectiveness of library instruction towards student learning
- RIS’s qualitative research project on faculty research assignments
- DLI’s assessment of tools for improved discoverability of digital library resources
The Assessment Committee has been instrumental in cultivating a culture of assessment here at TUL. As important, is the participation and engagement of all staff in our efforts. If you have an idea, a comment or question, please do contact me or one of our members!
Nancy Turner, Chair
Jenifer Baldwin, RIS
Steven Bell, RIS
Lauri Fennell, HSL
Leanne Finnigan, CAMS
Eugene Hsue, Law
Doreva Belfiore, DLI
Jessica Lydon, SCRC
Nicole Restaino, Communication/Events
Brian Schoolar, Collections
Cynthia Schwarz, LTS/HSL
Caitlin Shanley, RIS
Gretchen Sneff, SEL
Diane Turner, Blockson Collection
Sandi Thompson, Ambler
John Oram, Access