3. http://www.arl.org/stats
“Call to Action: Creating Tomorrow’s
Libraries Today”
• It really did not matter how “user
friendly” our libraries were ….. our
users would become confused and
frustrated trying to help themselves
and ultimately would seek our help
Rush Miller, Choice Magazine, April 2015
8. http://www.arl.org/stats
Association of Research Libraries
ARL Statistics and Assessment
…To describe and measure the
performance of research
librariesand their contribution to
teaching, research, scholarship and
community service …
9. http://www.arl.org/stats
Association of Research Libraries
ARL Statistics and Assessment
…To describe and measure the performance of
research libraries and their contribution
to teaching, research,
scholarshipand community
service …
10. http://www.arl.org/stats
ARL Toolkit for Demonstrating
Library Value
ARL Statistics
®
2005 (1906)
LibQUAL+
®
2000
MINES for
Libraries
®
2003 (1985)
ClimateQUAL
®
2008StatsQUAL® 2005
Library Value and Strategic MetricsLibrary Value and Strategic Metrics
LibValue 2009
12. http://www.arl.org/stats
Wendy Pradt Lougee (2002-present)
• What would you
like to know about
research libraries
if you were the
library director at
the U of
Minessota in
2014?
19. http://www.arl.org/stats http://www.minesforlibraries.org
Measuring Digital Content Use
The most popular current method of measuring usage of
electronic resources by libraries is not through web-
based usage surveys, but through vendor supplied data
of library patron usage or transaction usage.
Web-based usage surveys are increasingly relevant in the
collection of usage data to make collection development
and service decisions, to document evidence of usage
by certain patron populations, and to collect and analyze
performance outputs.
Brinley Franklin and Terry Plum, “Successful Web Survey Methodologies for Measuring the Impact of Networked
Electronic Services (MINES for LibrariesTM
)” IFLA Journal 32 (1) March, 2006
20. http://www.arl.org/stats http://www.minesforlibraries.org
What is MINES for Libraries
• Action research
– Historically rooted in indirect cost studies
– Set of recommendations for research design
– Set of recommendations for web survey
presentation
– Set of recommendations for information
architecture in libraries
– Plan for continual assessment of networked
electronic resources
– An opportunity to benchmark across libraries
21. http://www.arl.org/stats http://www.minesforlibraries.org
MINES for LibrariesTM
• MINES is a transaction-based research methodology consisting
of a web-based survey form and a random moments sampling
plan or a random instance transaction
• MINES typically measures who is using electronic resources,
where users are located at the time of use, and their purpose of
use in the least obtrusive way
• MINES was adopted by the Association of Research Libraries
(ARL) as part of the “New Measures” toolkit in May, 2003. 50
North American universities overall. More than 150,000 North
American networked services uses have been surveyed using a
standard protocol.
• MINES is different from other electronic resource usage
measures that quantify total usage (e.g., Project COUNTER, E-
Metrics) or measure how well a library makes electronic
resources accessible (LibQUAL+™).
22. http://www.arl.org/stats http://www.minesforlibraries.org
Questions Addressed By MINES for Libraries™
• How extensively do sponsored researchers use
electronic resources? How much usage is for
non-funded research, instruction/education,
student research papers, and course work?
• Are researchers and instructors more likely to
use the electronic resources from inside or
outside the library? What about other
classifications of users?
• Are there differences in the use of electronic resources depending on
the user’s location (e.g., in the library; on-campus, but not in the
library; or off-campus)?
• Could MINES for Libraries, combined with usage counts, provide an
infrastructure to make electronic resource usage studies routine,
robust, and easily integrated into administrative decision-making
process for assessing networked electronic resources?
34. http://www.arl.org/stats
• Assessing the Value of E-Resources to Yor
Aaron Lupton and Catherine Davidson,
Journal of Web Librarianship 7, no. 4
(2013): 422-433.
http://www.minesforlibraries.org
35. http://www.arl.org/stats
• What Is Different About E-Books?: A MINES
Terry Plum and Brinley Franklin, portal:
Libraries and the Academy 15, no. 1
(2015): 93-121, doi:
10.1353/pla.2015.0007.
http://www.minesforlibraries.org
36. http://www.arl.org/stats
• Assessment of the usage of electronic reso
Rachel Lewellen and Terry Plum,
Presentation, 2014 Library Assessment
Conference, Seattle, Washington, August
4-6, 2014.
http://www.minesforlibraries.org
40. http://www.arl.org/stats
Association of Research Libraries
Dimensions of
Library Service Quality
Information Control
Library
Service
Quality
Self-Reliance
Equipment
Timeliness
Ease of Navigation
Convenience
Scope of Content
Affect of Service
Library as Place
Reliability
Assurance
Responsiveness
Empathy
Refuge
Symbol
Utilitarian Space
45. http://www.arl.org/stats
• The library is not the starting point
• The campus is not the work location
• The proxy is not the answer
• The index is not current
• The PC is not the device
• User accounts are not well implemented
• Failure is not inevitable
“interface and experience are baseline requirements for a content
platform just as much as a binding is for a book”
49. http://www.arl.org/stats
Google Analytics Training
http://www.minesforlibraries.org
June 25 – San Fransisco
•Web Analytics Basics—what can we measure?
•Google Analytics Overview—how it works, implementation and
configuration issues, data quality, and privacy
•Google Analytics 101—tour of reports, metrics definitions, features,
and functions
•Advanced Analysis—custom reports, advanced segments, site
search reporting, content grouping, event tracking, and e-commerce
tracking
•Key Metrics for Actionable Insights—library websites, digital
libraries, OPACs
•Critical Google Analytics Configuration Steps—goal tracking, site
search, campaign links, filters, and profiles
http://www.arl.org/events/upcoming-events/event/165#.VSvB3pPMmjA
50. http://www.arl.org/stats
• “It is critically important for institutions to
gain a strong understanding of the value
of institutional repositories and digitized
materials as these resources represent a
large and growing part of the
utilization and public
awareness of our collections.”
– Box Fox, University of Louisville
… It really did not matter how “user friendly” our libraries were, since students had to use them regardless. We knew what was best for students and would arrange our libraries and array our services to meet their needs, whether they were pleased or disappointed with the outcome. We really did not measure how well they understood our jargonized signage ….. We simply perched ourselves behind desks and waited until the inevitable happened: our users would become confused and frustrated trying to help themselves and ultimately would seek our help. The wise ones started with us!
We lost that captive audience ….
- Rush Miller, Choice Magazine, April 2015
Is this the first year that you are working on the ARL Statistics for your institution?
Did you attend last year’s webcast?
115 ARL university libraries
73 medical libraries
77 law libraries
10,037 professional staff members
974 staff members at medical libraries
734 staff members law libraries
11 nonuniversity ARL members
3,709 professional staff members
This is a breakdown of how many transactions we were able to track and where the numbers fell. These are numbers from Fall 2011 and they probably aren’t that big of a surprise. All together we collected about 1.5 million transactions for the 13 library access points we tracked. Note again that we grouped those 13 access points into 5 broad categories.
How extensively do sponsored researchers use the new digital information environment?
Are researchers more likely to use networked electronic resources from inside or outside the library?
Are there differences in usage of electronic information based on the user’s location (e.g., in the library; on-campus, but not in the library; or off-campus)?
What is a statistically valid methodology for capturing electronic services usage both in the library and remotely through web surveys?
Are particular network configurations more conducive to studies of digital libraries patron use?
IC-3 - The printed library materials I need for my work
Faculty though were not convinced that libraries had the print the needed in 2003 – they do nowadays it looks like with perceptions scores finally meeting minimum expectations starting with 2008.
IC-8 - Print and/or electronic journal collections I require for my work *Highest average Desired rating of any sub-group (Faculty)
Faculty to this day do not think that the greatest and richest libraries in the world offering a couple of hundred thousand journal subscriptions, have enough subscriptions to satisfy their needs – or better said their minimum expectations.
IC-2 - A library Web site enabling me to locate information on my own
But the story is different when it comes to faculty where their perceptions of how libraries are doing shows that they do not meet their minimum expectations.
In general, undergraduate students need a good library space where they can use it in a variety of ways – individual study, group study, small/large, quiet, interactive … faculty need mostly content and good access to that content. And neither of them care that much for the ‘affect of service’ element – not that they do not want the librarian’s personal touch but they seem happen with it in general and the differentiating attraction of the library for them in respectively space for undergraduate students and collections for faculty.