The document summarizes a presentation on inclusive reading lists at the University of West London (UWL). It discusses how UWL has embedded inclusive reading lists into its library strategy and access and participation plan to narrow attainment gaps between student groups. It outlines different approaches taken by various colleges, including evaluating the impact on awarding gaps. UWL defines inclusive items and has developed guidelines for academic staff. Evaluation of reading lists shows a decrease in attainment gaps for Black, Asian and global majority students compared to White students on modules with more inclusive reading lists.
2. What we will cover today
Project origins and embedding into the Library
Strategy and UWL Access and Participation Plan
Andrew 20
Different approaches we have taken Davina 15
College of Nursing, Midwifery and Healthcare
approach
Marc 10
Evaluating the impact on Awarding Gaps Eirini 15
London College of Music approach Janice, Giselle and
Catherine
20
Questions for the speakers
#uwlirl
3. Project origins and
embedding into the Library
Strategy and UWL Access
and Participation Plan
Andrew Preater
Director of Library Services
#uwlirl
4. Student Attainment Project (SAP2)
Aim: narrow and eliminate awarding gaps between different
student groups
Based on proven successful pedagogic practices or 'interventions'
Change rooted in strategic, cross-institutional support
Centres student voice in design and implementation
SAP2 (2019) Student attainment project 2. Available at: https://stuattainment.wpengine.com/ (Accessed: 8
December 2022).
5. Reduction of awarding
('attainment') gap between
White and Black students.
Note: national data, not UWL.
Office for Students (2022) Access and participation data
dashboard. Available
at: https://www.officeforstudents.org.uk/data-and-
analysis/access-and-participation-data-
dashboard/ (Accessed: 8 December 2022)
6. How to create meaningful change
Aim: narrow and eliminate awarding gaps between different
student groups
Based on proven successful pedagogic practices or
'interventions'
Based on strategic, cross-institutional support
Centres student voice in design and implementation
SAP2 (2019) Student attainment project 2. Available at: https://stuattainment.wpengine.com/ (Accessed: 8
December 2022).
7. Student Attainment Project (SAP2)
Inclusive Reading Lists (IRL), new priority for SAP2
Leverages SAP2 principles; cultural capital frame
Aims to foster cultural change
SAP2 (2019) Student attainment project 2. Available at: https://stuattainment.wpengine.com/ (Accessed: 8
December 2022).
8. Library Strategic priority
1.3 Place students from communities and groups underrepresented
in higher education at the heart of our service, prioritising their
attainment and progression. Informed by student voice and
underrepresented areas of the collection, develop library resources
and course materials to be more inclusive and representative of our
students' diverse identities, rooted in an intersectional approach.
UWL (2019) Library Services strategy 2018-2023. Available at: https://www.uwl.ac.uk/current-students/library/library-
policies-and-regulations/library-services-strategy-2018-2023 (Accessed: 8 December 2022).
UWL (2022) Library Service standards and key performance indicators (KPIs). Available
at: https://www.uwl.ac.uk/current-students/library/library-policies-and-regulations/library-service-standards-and-
key (Accessed: 9 December 2022).
9. Embedding IRL in UWL strategy
Access and Participation Plan (APP) ensures University
ownership
UWL's APP Group ensures oversight and visibility
APP activity is evaluated, ensuring accountability
UWL (2020) University of West London access and participation plan 2020-21 to 2024-25. Available at:
https://www.uwl.ac.uk/sites/uwl/files/2021-12/Access%20and%20Partcipation%20Plan%202020-2025.pdf
(Accessed: 8 December 2022).
10. IRL isn't 'decolonisation' / anti-colonial
Decolonisation is, “a way of thinking about the world which takes
colonialism, empire and racism as its empirical and discursive
objects of study; it re-situates these phenomena as key shaping
forces of the contemporary world, in a context where their role has
been systematically effaced from view. Second, it purports to offer
alternative ways of thinking about the world and alternative forms
of political praxis.”
Bhambra, G. and Gebrial, D., and Nişancıoğlu, K. (2018) Decolonising the university [Online].
London: Pluto. Available at: https://www.perlego.com/book/2329405/decolonising-the-university-pdf
(Accessed: 6 December 2022).
12. Timeline
18/19 KPI launched and discussions with academic colleagues started/continued
19/20 had a separate budget of £22,222
20/21 Co-create campaign launched, focus group with students and APP tracking began
21/22 tracked spending monthly with a 15% ringfenced budget
22/23 tracking spend and titles but unique titles the key figure
13. KPI: Increase % library collection reflecting Black, Asian and
Global Majority authorship
Year
Number of unique
authors
Authors
researched % Researched
% of Black, Asian and
Global Majority authors
2017/18 1894 246 14% 9%
2018/19 1312 171 13% 12%
2019/20 3242 433 13% 6%
2020/21 1410 183 13% 14%
15. Budget
21/22 Inclusive spending Unique titles
School 1 24% 29%
School 2 28% 31%
School 3 20% 27%
School 4 16% 20%
School 5 19% 31%
School 6 33% 35%
School 7 23% 26%
School 8 16% 23%
School 9 15% 20%
TOTAL 22% 26%
16. UWL definition for an inclusive item
"Sources that widen the student's experience of relevant cultural and
social perspectives, including in terms of authorship and content that is
more inclusive and representative of our students' diverse identities, and
which gives a greater sense of the breadth and diversity of their
professional community."
17. Ongoing work considering content
1.Authored by a person from a marginalised/underrepresented group
2.Authored by a person from a contextually underrepresented group
3.The content of the book (at least 50%) should relate to a
marginalised/underrepresented group
18. Table for reading list
Very high High Medium
Main key item is inclusive (where there
is one key item for the module)
AND/OR
50% or more of essential items are
inclusive
AND/OR
More than 70% of essential and
recommended items combined are
inclusive. One item has to be an
essential one (if there are any essential
reading).
At least one essential item on
the list is inclusive (2 or more if
list has more than 5 essential
items)
AND/OR
50% or more of essential and
recommended items combined
are inclusive
50% or more of recommended
items are inclusive
AND/OR
One essential item is inclusive
for lists where there is more
than 5 essential items
19. Moving to more consistent checking
L4 L6
Very High 19% 50%
High 38% 27%
Medium 19% 3%
20. Co-create UWL Library
We’ll buy books that you want to read
Perhaps there is a book you’d like to read that’s not currently in
our collection? Perhaps you’ve read something great that
ought to be added to our collection? We’d love to hear your
recommendations for inclusive titles.
21. Focus group and semi structured interviews
In 20/21 we conducted a small focus group and 2 semi structured interviews with
students who had studied a module with an inclusive reading list.
The questions asked were around awareness, value, impact, benefit, importance,
expectations and next steps.
22. Quotes from this work
…interesting thing about this one is that there some renowned
authors that everybody knows, you know, and it's easy
to quote from them and to know about them because you
are constantly talking about them or being taught their materials…
but equally there's so many other authors that are so profound, are
doing so well, but because they are not known, they have not
been given the opportunity.
The more inclusive and diverse the material is I think we will learn
more from it cause we are getting more knowledge from a range of
backgrounds, a range of thinking styles not just a set like one view.
23. Developing Inclusive Reading List Guidelines for
Academic Staff for the College of Nursing,
Midwifery and Healthcare
Dr Marc Forster
Subject Librarian
24. What were the issues?
'Inclusive reading lists is a good idea but...... '
• 'I haven't the time' - a 'College Policy'?
• 'I don't know what to do' - not necessary to rebuild from
scratch; give your existing lists additional experiential perspectives
• 'What is an inclusive resource?' - how are they defined?
• 'I don't know where to find inclusive resources' -
have you thought about...... smaller publishers; more journal articles,
blogs, NGO docs etc
25. What we did
• What about a guideline?
• Will it be taken up? - we need executive support
• Who will write it? - executively appointed!
• Meeting up. Enthusiasts and 'no responders'
• The Guideline's Structure: 'Why (is the guideline needed),
which (new perspectives), what (kind of resources), where (can we
find them)'
• Taking the draft to subject teaching groups
• 'Implementation'.
27. Evaluation Design & Phases
• Empirical design to evaluate the impact of IRLs on attainment rates, and
consequently awarding gap, between students coming from a Black, Asian and
global majority background and White students
• Three (3) research and evaluation (R&E) phases
• Module- and Student- level analyses
• Year on year (YoY) comparison
31. Impact of IRLs on Awarding Gap
Module level analysis
Student level analysis:
pre- & post-IRL activity
• An increase of 1.6% for Black,
Asian and global majority students
after the introduction of the IRL
• No change for White students
An awarding gap of 5%
between Black, Asian and global
majority and White students on the
assessed modules.
• A statistically significant decrease of
2.5% following the delivery of the IRL
activity (post-IRL)
• The activity contributes positively
mainly on students coming from
a Black, Asian and global
majority background
• Students coming from a Black
background found to be benefited the
most; particularly from modules with a
very high IRL
34. Impact of IRLs on Awarding Gap
Black, Asian and global majority x
White
Black vs. White
35. Impact of IRLs on Awarding Gap
Ethnicity x inclusivity x
attainment rates
Semester 1 vs. Semester 2
comparison
• Black, Asian and global majority
group: Higher grades are presented in
modules with very high IRL
• Black students: Higher grades are
presented in modules with very high
IRL
• White students: Higher grades are
presented in modules with high IRL
38. Impact of IRLs on Awarding Gap
Black, Asian and global majority
x White
Black vs. White
39. Impact of IRLs on Awarding Gap
• Black, Asian and global majority group: Higher grades are presented in modules
with very high IRL
• Black students: Slightly higher grades are presented in modules with very high
IRL; but the differences between the levels of inclusivity are minor
• White students: Higher grades are presented in modules with medium IRL
42. London College of Music approach
Dr. Giselle Garcia - Lecturer : Dramaturgy and
Performance Studies
Dr. Catherine Sloan - Lecturer : Applied and
Socially Conscious Theatre
Dr. Janice Fernandes - Subject Librarian, LCM
I want to open by saying that all the principals of what I will talk about here are within your ability to replicate in your institutions.
To create meaningful change, particularly cultural change is years of work – and today we are talking about work starting from 2017/18 academic year.
Inclusive Reading Lists or "IRL" originates with this Office for Students-funded project which ran between 2017 and 2018.
SAP2 was a HEFCE and later Office for Students-funded collaborative project with University of Derby and Solent University.
In 2017/18 I joined the Student Attainment Project (SAP2) at UWL in a champion role.
SAP2 was based on proven successful pedagogic practices, which we term "interventions".
The main aim of the project was to narrow and eliminate awarding gaps between different student groups.
We say "eliminate" because our view is it is not acceptable to design medium to long-term aims that maintain some inequality. The aim must be to eradicate it.
This is public data from Office for Students, what you can see here is the gap in 'good degrees' between Black students and White students.
Our status quo is not equality or equitable outcomes. About the best thing we can say about this is, it is decreasing year on year. Nevertheless, this is a source of shame for higher education as a sector.
This is national data, so do go and familarise yourself with your own institutions gaps. Your own students and applicants can of course see the same data.
Within your institutions, your planning or data teams may have data like this down to the level of your academic departments or schools, which you may find very revealing.
Awarding gaps are complex and multifaceted, and changing teaching and assessment practices certainly are crucial to narrowing and eliminating them. So going back to library resources...
We believe to fully address unequal outcomes, we must work on a whole-institution basis across all touchpoints our students have with us during their study.
This means, not addressing representation and inclusivity only in library collections or only in pedagogic practices for example, but working on these and many other aspects of our work with cross-institutional support.
That means across academic schools and professional services and with student voice centred.
The point about cultural change is key.
As a library team, we created a new strategic priority that the library would develop more inclusive and diverse library collections and reading lists, which situated within UWL's Inclusive Curriculum intervention.
In justifying this in theory, I base this on the argument made by Black, Asian and global majority student, academic and library leaders (eg. Clarke, 2022; Gyebi-Ababio, 2022; Wilson, 2017) that materials used in the curriculum to be inclusive must be diverse, and reflect and represent the diversity of students themselves.
So that core argument is based on descriptive representation, that is the concept that to be representative a group (such as our library staff) or a pedagogic artefact (such as a reading list) should resemble the community it is drawn from.
Boudieu's concepts of cultural and social capital inform our work at UWL. For us librarians, our work involves intentional selection of and providing access to these cultural capital – in form of information resources and independent use of which is one way learners develop embodied cultural capital.
It is the case that libraries act as a legitimising agent for these resources. If we provide very monocultural, very skewed collections and reading lists, we do give the impression of acceptability of that worldview.
Strategic priority for our five-year strategy ensures Library Services ongoing focus – this was something I knew we needed to work on over years, not a one-off project.
We also developed a key performance indicator so we could track this work, which is based on assessing our purchasing of first-author titles by Black, Asian and global majority authors.
Quantitative analysis like this is very unusual in our sector (I am aware of similar work at UCL by Lesley Pitman and colleagues). As far as I'm aware this type of KPI measure is unique.
I know some colleagues object to the idea of setting targets. Using any kind of measure could be called out as neoliberal – of using the logic and measurement of markets to inform our work in higher education; which should be a public good.
However, we thought that we did need to know both where we were starting from and have a measure by which to understand progress. This sits alongside a range of other evaluative measures both quantitative and qualitative.
Is this decolonisation, with or without the quote marks around it, or anticolonial work?
There are risks in calling work like this "decolonisation" when it is not: you risk getting that "culture war" pushback and negative attention, while at the same time you are not actually doing any anti-colonial work. That is the worst of both worlds.
So, although we do not describe this as "decolonisation" there is overlap in our methods with similar projects in peer institutions that are framed in this way.
The following slides show the work that was done by the Academic Support team and our academic colleagues. I am presenting it on their behalf and my thanks go to my colleagues for the work they have been doing.
We have approached this throughout in terms of library collection as well as reading list.
But we are aware that by an item being on a reading list this is indicating to a student that the texts reflect authority and expertise. Meaning some voices are highlighted or elevated and others excluded giving students only a limited perspective.
That is why for UWL it is so important that we consider reading lists so closely as well as thinking about the full library collection
We were wanting to know what our starting point was and then track progress.
What became clear is that we should have gone with a KPI that reflected the intersectional approach that we were going to take. Our subsequent work does take that into account.
We have kept the KPI as it is due to the importance we place on ensuring diversity in the ethnicity of our authors but we will change it for the new strategic plan.
We can’t explain the difference in 19/20 and it doesn’t appear to be related to the impact the pandemic had in purchasing ebooks. The other noticeable difference in that year was the number of authors we purchased from.
The KPI was started in 18/19 but we backdated it to 17/18 due to the difference we found in 19/20.
Although we have never reported on this, we have also tracked for all 4 years so far, the gender of the authors as well. For gender, it has ranged from 28% to 30% women authors.
The KPI covers first authors only and 2 independent members of library staff research the authors.
Ideally we wouldn’t do it this way and would only base the KPI on ethnicity data provided by the authors directly (where they were happy to supply it)
Constantly meeting as a group to discuss what our progress was and what was causing us some delay. It is a standard item for the monthly team meetings and discussed at most 1-2-1s we have in the team.
We were aware that there were different starting points in the different schools/colleges and that this project needed to go hand in hand with inclusive curriculum and assessment work.
In October 2019, we had a review meeting with subject librarians, Andrew and Pro Vice Chancellor for Student Experience. Feedback at this meeting showed:
Budget is needed to purchase inclusive content
Time is needed for module teams and librarian to research new items to add to lists
Would help if priority could be assigned to this by senior leaders in the school/college (where this isn’t already in place)
Availability of format is required from publisher
Availability of content from Black, Asian and Global Majority authors needs to be promoted by publishers and content commissioned from a diverse set of authors
Definition of what an inclusive reading list is needs to be made clear to module teams
Extra staff/time required for some modules especially if taught by HPLs
Need to consider further how we identify items where the content is inclusive but not the authorship (we will be piloting work on this shortly)
We embedded some training on creating inclusive reading lists within the compulsory training on the new Blackboard environment in early 2020. This was the first time we had more formally advised academics on inclusive reading lists.
We have tried 3 different ways of managing this.
19/20 – a separate budget but not. We had allocated the budget but the order went from the normal school/college budget. We didn’t want to consider the inclusive items as separate to our normal spending. This meant that in theory money would need to keep transferring between budgets. In practice this didn’t work.
20/21 – inclusive spending came from the normal school/college budget and we tried to keep track for through a shared excel document. Again in practice this was too prone to things not being recorded correctly.
21/22 – We formally ringfenced 15% of the budget and tracked spending per school per month. This worked much better but we soon realised we should have done it on title rather than spend. That was a more accurate figure of how much content was being purchased. We tracked both throughout the year and we were more consistent on noting which items were inclusive by incorporating it into the ordering process
22/23 – We thought 4 years in we would now be at the point of being stable on how we track it but new changes came in (good but challenging to track) Perlego.
Developed in January 2021 around the time we were developing a formula for the reading lists. Was to help us be more consistent and clear in the work we were doing.
Underrepresentation of inclusive items does differ across the subject areas. Some subject areas might have a quite an even gender split in terms of authors for example. We have tried to consider this very much at subject level.
And although I have only mentioned books really so far, we have been looking at this across different formats.
What we were conscious of as we were analysing our spending was that we didn’t have a definition for defining a book inclusive based on content rather than authorship.
Although we have for the last 4 years considered the authorship of the items, we have only in the last few years been considering the content within the book as well. This is still very much a work in progress as we consider the best ways of trying to be consistent in this work. For 22/23 the subject librarian for Film, Media and Design has drafted some guidelines.
We are currently working on a 50% mark for the inclusiveness of the content but will be testing this throughout 22/23 to see whether this should be a higher percentage.
Example from the guidelines
Displacement
The content of the book relates to the lived experience of those who have sought, or are seeking, asylum or refugee status
Ethnicity
The content of the book relates to those from the Global South, or those with heritage from the Global South
The content of the book relates to Indigenous peoples, or those with Indigenous heritage
The content of the book relates to Roma or Irish Traveller communities, or those with Roma or Irish Traveller heritage
The content of the book relates to white privilege or whiteness studies
Developed to assist with the APP work to ensure some consistency across the schools and colleges.
We were conscious when developing this table that the length of reading lists were quite different across the subject areas, not all had essential reading and that we wouldn’t always know the inclusivity of some items on the list.
Main issues faced is that we haven’t systematically checked each reading list against this formula. We apply this formula generally to new lists or lists where we know an academic (potentially with their librarian) has been working on diversifying the content.
Therefore there is potentially quite a lot of RL that we don’t know are inclusive as they haven’t been checked. Of the ones we know about we estimate that only 8% are between medium and very high in inclusivity so we know we have a long way to go yet.
This academic year we are trying to do more consistent checking of lists to see their level of inclusivity. A colleague looked at a subject area’s L4 and L6 reading lists. There were several lists that they were unable to decide upon due to the lack of information so the above only reflects the lists that could be researched.
We do think taking a more consistent approach will be beneficial especially when hand in hand with the guidelines being developed.
Started co-create campaign in 20/21 but not much interaction with it from students.
Towards the end of 21/22 we redesigned it to be much clearer and easier for the students to suggest material.
Now includes examples to help inspire students on the content we are looking for.
The book is authored by a person from a marginalised and/or underrepresented group.
For example: an LGBTQ+ writer; a writer with a disability; a writer from a working-class background; a writer from the Global South; a writer with heritage from the Global South.
The book is authored by a person from a contextually underrepresented group.
For example: a woman writer in a field dominated by male writers.
The content of the book relates to a marginalised and/or underrepresented group.
For example: indigenous populations; queer studies; fat studies.
We wanted to hear directly from the students and felt this would be useful in discussions with academic colleagues as well as publishers, content providers etc.
We didn’t expect that this exercise would elicit different responses to the comments that students from other institutions had provided in other research but we felt there was a real power to hearing from UWL students.
We asked 10 questions.
During your studies this academic year, have you noticed for any of your modules whether the reading list was inclusive. Is this something you would naturally look for at the start of using the reading list or something that you become aware of during the module?
Do you see any value in having an inclusive reading list in your module? Why do you feel that way?
What impact does having an inclusive reading list have on your learning and engagement in the module?
If you do see a benefit, does this extend to your full course or do you find the benefit only in the module with the inclusive content?
How important is having an inclusive reading list to you in terms of your success in the module and course?
What is your expectation of what an inclusive reading list looks like?
We would consider an item inclusive in terms of authorship and/or content (case studies, examples, edited chapters etc) What would be your expectation of an inclusive item?
Has there been a change in the amount of inclusive content you have seen in the library (not on reading lists) throughout your course and does this have an impact on you?
For modules you study without an inclusive reading list, what would be your message to the module teams and library about this?
What would you say is the most crucial thing the library and university should do in the coming 12 months in terms of inclusivity?
These two quotes I found very powerful and impactful. A theme from the research was in addition to the above how important the subject relevance of the materials are