A presentation at the Rethinking Peace, Conflict and Governance conference in Sydney (12-14 February 2020)
The full script for the presentation is available from https://sustainingcommunity.wordpress.com/2020/02/21/avp-&-refugees
Alternatives to Violence Project, Social Capital and People from Refugee Backgrounds
1. Graeme Stuart
Social Capital and People
from Refugee Backgrounds
The script and slides are available from
https://sustainingcommunity.wordpress.com
/2020/02/21/avp-&-refugees
2. Evaluation
team
Ansuya Naguran
David Ajak Ajang
Helen Bibby
Jasmina
Bajraktarevic-
Hayward
Ken Woods
Graeme Stuart
Katherine Smith
Raphael Manirakiza
Wendy Lambourne
3. Research and AVP
History of participant feedback
but not research
Increasing focus on research
AVP International Research
team
5. Wheel of research evidence
Correlation
studies
Qualitative
studies
Case
studies
RCTs
Quasi-
experiential
(Epstein, 2011)
6. STARTTS
• Supports people healing from
torture and refugee trauma
who are rebuilding their lives
in Australia
• Recognises that peace-
building and reconciliation
are important parts of trauma
recovery
• Committed to clinical and
community-based research
and evaluation
7. STARTTS and AVP
• Partnership since 2011
• STARTTS provides venue, lunch,
resources and participants
• STARTTS staff trained in AVP
• Increased the diversity of
participants and faciltators
• Developed a workshop on trauma
awareness
• Generally one workshop/month
9. Indicators
Social Capital Outcome* Selected Indicator*
Increased self-confidence, self-
esteem and self-worth
Increased ability to calmly handle difficult or
culturally challenging situations
Increased sense of safety and
stability
Increased understanding of how to address and
manage conflict
Increased trust
Increased willingness to engage with people
from outside one’s immediate community
Increased harmony with family
and other close social contacts
Increased positive communication with family
members and other close social contacts
Strengthened or expanded
connections with people from
outside one’s immediate
community
Increased positive relationships with people
outside your immediate community or locality
* (Bartolomei et al., 2013)
10. Evaluation process
•General self efficacy
scale (Schwarzer & Jerusalem, 1995)
•Self created social
capital scale
Pre & Post
question-
naire
•Start of Basic and
Trauma workshops
•End of Advanced and
Training for Facilitators
Focus
groups
12. Group Averages: Social Capital Scale
2.9
3.1 3.2
3.4
3.6 3.6
1
2
3
4
Basic Advanced T4F
GROUPMEANS
Pre Post
**
* p<.05 ** p<.01
***
13. 1. Increased understanding
of how to address and manage
conflict
• Able to explore, identify and
adopt nonviolent approaches to
conflict resolution
• Approaches were less
aggressive, more thoughtful
and more strategic
• The simplicity of the
transformational keys captured
in the AVP mandala
14.
15. 2. Increased positive communication
with family members and other
close social contacts
• Cultivated greater harmony in family and
other relationships
• Increased with more workshops
16. 3. Increased positive relationships
and willingness to engage with
people from outside one’s
immediate community
• Provided opportunities for participants to form
connections with people from outside their
immediate communities
• Increased trust
• Expanded social networks
17. 4. Increased knowledge of
trauma and conflict
• Became aware that trauma impacts everyone,
and this awareness cultivated a greater sense
of compassion and empathy
19. References
• Bartolomei, L., Pittaway, E., & Ward, K. (2013). ‘The glue
that binds’ the social capital evaluation tool: Objectives
and indicators for social capital projects with refugee
communities settling in Australia. Sydney: STARTTS.
• Schwarzer, R., & Jerusalem, M. (1995). Generalized self-
efficacy scale. In J. Weinman, S. Wright, & M. Johnston
(Eds.), Measures in health psychology: A user’s portfolio.
Causal and control beliefs. Windsor: NFER-Nelson.
• Epstein, I. (2009). Promoting harmony where there is
commonly conflict: Evidence-informed practice as an
integrative strategy. Social Work in Health Care, 48(3),
216-231. doi: 10.1080/00981380802589845
Editor's Notes
The final presentation [in a session about Alternatives to Violence Project (AVP)] is about an evaluation exploring the impact on social capital of AVP workshops with people from refugee backgrounds.
The workshops and associated evaluation involved a partnership between STARTTS (Service for the Treatment and Rehabilitation of Torture and Trauma Survivors) and AVP in Sydney.
Before discussing the research, we want to make a few general comments about AVP and research. AVP has a history of participant feedback (e.g., there is usually verbal feedback after each session so that the workshop can be modified depending on the participants) but there has been little formal research or evaluation done. Some facilitators feel that the experiential nature of the workshops does not sit comfortable with research trying to identify what the outcomes of workshops are. It is up to participants what they get out of a workshop.
But recently there has been a growing sense that AVP needs need to have a greater focus on research and evaluation, and I am one of the co-convenors of the AVP International research team.
Internationally, there has been an increasing emphasis on evidence-informed practice, evidence-based practice and evidence-based programs, particularly in human services. Generally, evidence-based programs need to be standardised and systematised (so they can be replicated) and rigorously evaluated. By rigorously evaluated, registers of evidence-based programs generally mean evaluations that are higher up the hierarchy of evidence, with randomised controlled trials being the “Gold Standard” and little consideration being given to qualitative research.
AVP is not a standardised program which makes it difficult to use some of the research methods higher up the hierarchy. One of real strengths of AVP is that it can easily be adapted to different contexts. This means there is a great deal of variation in workshops and, at the same time, AVP workshops are easily recognisable anywhere in the world because of its characteristic practices and processes. This lack of standardisation and the wide range of outcomes for participants, create significant challenges for undertaking research coming from a narrow understanding of what counts as evidence.
It may not be surprising then, that when some colleagues in the USA recently attempted to have AVP listed on a register of evidence-based programs, they discovered that AVP’s evidence base was not strong enough. (Even thought there is quite a bit of literature published on AVP.)
Epstein’s wheel of research which recognises the value of many different approaches to research, sits more comfortably with AVP.
We’re now going to move on to the evaluation we’ve been doing over the last few years in partnership with STARTTS.
STARTTS supports people healing from torture and refugee trauma who are rebuilding their lives in Australia and recognises that peacebuilding and reconciliation are important parts of trauma recovery. Because they are committed to clinical and community-based research, STARTTS has been working with AVP in NSW on this evaluation.
The partnership between AVP and STARTTS began in 2011, because the STARTTS’ Community Services coordinator, Jasmina Bajraktarevic-Hayward, had completed an AVP workshop many years ago, and thought it had real potential for their work. Now, in 2020, quite a few STARTTS staff have now trained in AVP and some have gone on to complete the Training for Facilitators (T4F) workshop and STARTTS provides a venue and lunches for the Sydney workshop, provides administrative support and is a major source of workshop participants.
The partnership has certainly seen an increase in the diversity of participants and facilitators in Sydney workshops, (which are help about one a month on successive Saturdays) and has led AVP NSW to develop a workshop on trauma awareness.
The social capital evaluation explored five outcomes related to social capital:
Increased self-confidence, self-esteem and self-worth.
Increased sense of safety and stability.
Increased trust.
Increased harmony with family and other close social contacts.
Strengthened or expanded connections with people from outside one’s immediate community.
The five social outcomes (on the left) had come from the previous STARTTS research, and for each we selected an associated indicator (again from the previous research), which was relevant to AVP. So these indicators were:
Increased ability to calmly handle difficult or culturally challenging situations
Increased understanding of how to address and manage conflict
Increased willingness to engage with people from outside one’s immediate community
Increased positive communication with family members and other close social contacts
Increased positive relationships with people outside your immediate community or locality
The evaluation involved a pre and post questionnaire and focus groups. The pre and post questionnaires, given to all workshop participants over a two year period ending in 2019, involved 19 questions incorporating the General Self Efficacy Scale (GSES, a widely used scale) and a self-created social capital scale (based on the STARTTS social capital research).
There have also been statistically significant increases in all workshops for the social capital scale (using the same 4-point scale). The results are pleasing, and we are about replicate the research in AVP workshop with people from refugee backgrounds in Tasmania.
There have also been statistically significant increases in all workshops for the social capital scale (using the same 4-point scale). The results are pleasing and we are about replicate the research in AVP workshop with people from refugee backgrounds in Tasmania.
The focus groups added depth to the results. Here we will briefly identify four major themes and give a few indicative quotes.
Participants reported an increased understanding of how to address and manage conflict.
They said they were able to explore, identify and adopt nonviolent approaches to conflict resolution. Some of them said their approaches were less aggressive, more thoughtful and more strategic. Some of them spoke about how the simplicity of the transformational keys captured in the AVP mandala.
One participant in an Advanced workshop said
“I would add that those keys, the transforming power keys, I like how they’re really simple. There is not too many of them so they are pretty easy to remember you know. And so, there is a simplicity I think that even though there is a lot of things done in AVP, there is also a simplicity that really helps a lot. So that is a key thing about AVP.”
Speaking personally, I find the five keys of the mandala—respect for self, care for others, expect the best, think before reacting and ask for a nonviolent path—very simple in theory but quite tricky to put into practice. For example, how can we really balance respect for self with caring for others and balance our needs with those of those around us?
Participants also said that they increased positive communication with their family members and other close social contacts. The workshop helped them create harmony in family and other relationships. Not surprisingly, the more workshops they did, the stronger the impact.
For example, a participant in an Advanced workshop said:
“Recently I was working with my dad who has been very difficult, and I addressed the situation with a really positive attitude and as a result of that it was a really positive outcome, even he said that too, attitude. Even attitude towards yourself.”
The workshops helped participants build positive relationships and a willingness to engage with people from outside their immediate community, by providing opportunities for them to form connections with people from the wider community, to increasing their ability to trust others, and to expand their social networks.
And finally, the trauma awareness workshop helped participants increase their knowledge of trauma and conflict. For example, they became more aware that trauma impacts everyone, and this awareness cultivated a greater sense of compassion and empathy. As one participant suggested in a Trauma Awareness workshops:
“We all experience trauma in one way, and it all harms us in one way and I think that brings people together to feel for each other.”
As we think of the next steps there are a few things we know:
We know AVP has lots of potential and makes a difference to communities and people’s lives.
Because it is so dependent on volunteers, it can only continue if people with passion believe in its potential for transformation.
But we also know that people believing in the value of something is not the same as being sure that it really is having a positive impact.
This means that we do need research and evaluation, but we need to do it in ways that are consistent with our values and our approach. I believe there would be real value in doing creative, qualitative forms of research, but these are unlikely to help us become recognised as an evidence-based program. If we are to go down this path we need to do more quantitative or mixed method research (like this one). We need to balance our needs, with those of others, which is a very AVP thing to do.