CESBC Webinar: Participatory Approach to Evaluation: Democratizing Evaluation and Embodying Social Inclusion

WHEN:  Thursday, October 10, 2019 from 12 pm to 1 pm Pacific Time

WHERE: CESBC webinars take place online using Zoom platform. You can check your computer’s requirements here

COST: Free (long distance charges may apply if you dial in rather than use Zoom app)

LANGUAGE: English

REGISTRATION: Register on Zoom

(Please join the webinar at 12:00 pm. And the webinar will end before 1:00 pm. The webinar is booked for a longer timeframe for organizational purposes only.)

Presented by Janice Duddy, Mona Lee, and Paul Kerber 

Webinar description:

The Pacific AIDS Network (PAN) is a community-based network supporting HIV/HCV organizations in BC. PAN uses a highly participatory approach to evaluation and will share learnings on the benefits, needed resources, and tools for this approach. When adapting to evaluation, PAN integrates community-based research (CBR) principles such as, ensuring that projects are collaborative, change-oriented and inclusive; have built-in supports to ensure participation of people with lived experience (PWLE); and grounded in methodological rigor and sound ethical practices. We have accomplished this by: bringing people most affected to the decision-making tables; building accessible evaluation training modules; and supporting Peer Evaluators to lead the work. To be successful, teams need to allow for extra time and resources and develop a culture of trust and learning. Impacts include: more relevant and nuanced evaluation questions; greater use of evaluation findings; empowering PWLE to lead evaluations; and democratizing evaluation and supporting social inclusion.

Biography of presenters:

Janice Duddy is the Director of Evaluation and Community-Based Research at the Pacific AIDS Network (PAN). She has worked at PAN since 2013 and has been the Director of Evaluation and Community-Based Research (CBR) since 2016 (a position supported by the CIHR Centre for REACH). Prior to her work at PAN she worked at the Provincial Health Services Authority

Mona Lee, Manager of Evaluation at the Pacific AIDS Network, started her evaluation journey as a Master of Public Health student at SFU. Now championing participatory approach and shared measurement framework in evaluation, she supports a number of evaluation projects in partnership with community-based organizations across BC and Canada.

Paul Kerber is the Evaluation Coordinator at the Pacific AIDS Network (PAN). He works on a diverse group of evaluation projects in British Columbia and Canada.

Permalink

PAN presents: Positive Living, Positive Homes at CAHR 2019

The 2019 Canadian Association for HIV Research (CAHR) conference was held in Saskatoon in April. As part of our work around community-based research, we presented findings from the Positive Living, Positive Homes study in a poster session. Our poster discussed findings around disclosure and stigma surrounding housing for people living with HIV.

To see greater detail in “The Tangle of HIV Disclosure, Stigma and Housing: Supporting Self Determination of People Living with HIV (PLHIV), view the PDF.

Learn more:

Permalink

PAN Creates Two Whiteboard Videos to Share Findings on BC People Living with HIV Stigma Index and Positive Living, Positive Homes Studies

PAN has worked to create two whiteboard videos as knowledge translation tools for two of our community-based research studies – the BC People Living with HIV Stigma Index and Positive Living, Positive Homes. “But what are whiteboard videos?” you may ask.

Wikipedia states:

Whiteboard animation is the process of which an author physically draws and records an illustrated story using a whiteboard, or whiteboard-like surface, and marker pens. The animations frequently are aided with narration by script. ”[1]

As a knowledge translation technique, whiteboard narration is often used to explain difficult and/or detailed concepts using voiceovers and simple, clear visuals.

Please check our videos out! We would love to hear what you think:

 BC People Living with HIV Stigma Index:

BC People Living with HIV Stigma Index from PANBC on Vimeo.

Positive Living, Positive Homes:

What supports Housing and Health for PLHIV in BC? Positive Living, Positive Homes from PANBC on Vimeo.

 

Be in touch with Madeline Gallard, CBR Coordinator: madeline@pacificaidsnetwork.org 

 

[1] Wikipedia contributors. (2019, March 14). Whiteboard animation. In Wikipedia, The Free Encyclopedia. Retrieved 17:35, June 27, 2019, from https://en.wikipedia.org/w/index.php?title=Whiteboard_animation&oldid=887690942

Permalink

Meet Madeline Gallard – BC’s New CBR Coordinator

Madeline (or M.P.) Gallard is PAN’s newest member of the REACH team in the role of CBR Coordinator! Madeline has lived intermittently in Metchosin/Sooke, Courtenay, and Langley, B.C., with a brief interlude in Ottawa, and holds a Bachelor of Arts (Honours) in Political Studies from Trinity Western University. Before joining PAN, they also had the opportunity to work for the Pacific Hepatitis C Network, as well as YouthCO as a Coordinator for the Mpowerment program in Fraser East. They now live in Abbotsford, B.C.

Madeline became interested in the HIV and hepatitis C sector during their undergrad, when they began to learn more about health equity – learnings which were reinforced by their experiences in a political internship. Madeline also witnessed and experienced differences in access to care and services in relation to their involvement with queer and trans organizing in their undergrad.

Madeline’s professional interests include exploring health equity, particularly in respect to rural and remote communities and for queer and trans people, and learning about innovative qualitative research methodologies. In their spare time, Madeline enjoys hiking, eating vegetarian food (but preferably not cooking it!), weightlifting, and watching Drag Race. Madeline is excited to engage with REACH and learn from the others on the team.

Permalink

PAN’s Checklist: What needs to be in place to provide adequate support to peer researchers?

In 2015, PAN began the BC People Living with HIV Stigma Index (BC Stigma Index), a community-based research (CBR) study to document the experiences of stigma and discrimination from the perspective of people living with HIV (PLHIV). One of the objectives of this study was to “support PLHIV to be Stigma Index leaders and build capacity for PLHIV to participate in research planning and partnership development.” Six peer researchers were hired to implement the BC Stigma Index across BC, as well as to participate in data analysis and knowledge translation and exchange activities. Following the data collection phase, the peer researchers were interviewed about their experiences of leading and participating in the BC Stigma Index. This checklist outlines questions to consider when working with and supporting peer researchers and provides a summary of lessons that PAN learned from these interviews about supporting peer researchers. We hope it will serve as a useful resource for other CBR projects and teams.

Permalink

PAN Presents at the 2018 CESBC Conference on Participatory Approaches to Evaluation

PAN’s Evaluation Team had the pleasure of presenting at the 2018 Canadian Evaluation Society BC’s Evaluation Conference that was titled: What’s in Your Evaluation Toolbox? The program was super interesting, with lots of great presenters.

We were able to present our approach to participatory evaluation in a demonstration session titled: Participatory Approach to Evaluation: Democratizing Evaluation and Embodying Social Inclusion and shared a number of resources with participants, Including a: Conference Summary and Resources Handout and Participatory Evaluation Checklist.

PAN has been doing a lot of work and thinking about participatory evaluation and has come to define this way of working as follows — Participatory evaluation:

  • Is collaborative, change-oriented and inclusive;
  • Has built-in supports to ensure participation of people with lived experience or peers (i.e. fair compensation and acknowledgement of work and access to supportive resources including content experts);
  • Supports capacity bridging[1]– importance of reciprocity of knowledge, skills and capacity amongst all involved stakeholders. Each person has knowledge to contribute and has room to learn; under this value, power hierarchy is minimized and equitable participation is maximized.
  • Is built on mutual respect and trust;
  • Is committed to long-term, sustainable relationships;
  • Is flexible;
  • Builds on existing community strengths; and
  • Ensures methodological rigor and sound ethical practices.

We have found outcomes to using this approach to evaluation include: community- and team-building; shared ownership of process and results; and enhanced utilization of evaluation findings. Ultimately we feel that this approach can help to democratize evaluation and support social inclusion of people not normally engaged in evaluation.

We look forward to sharing more about this approach in the future.

[1] A term proposed by AHA Centre (an Indigenous HIV Community-Based Research Centre)

Permalink

How Do We Measure Success? Developing Shared Outcome Tools for HIV Supportive Housing Services in Western Canada

A multi-province team spanning Western Canada has utilized a participatory program evaluation approach to develop shared outcome tools for HIV supportive housing programs. The team developed the tools to demonstrate how their programs improve not just the physical health of people living with HIV, but also their quality of life.

Baseline intake and follow-up tools were developed through a series of participatory workshops, interviews, and meetings that included frontline staff, clients, and the family members of service users. The aim of this process was to collaboratively build relevant outcome measures that were useful to services users and front-line staff, and were capable of demonstrating change over time among clients.

Led by Floyd Visser (The SHARP Foundation) and Dr. Cathy Worthington (University of Victoria), this project brought together service providers from across Western Canada. Service providers included Sanctum Group from Saskatoon, and McLaren Housing Society and the Dr. Peter AIDS Foundation from Vancouver. Additional partners included Dr. Brent Oliver (Mount Royal University), Dr. Hart Krentz (Southern Alberta HIV/AIDS Clinic), Janice Duddy (Pacific AIDS Network), and an HIV positive peer.

In addition to developing useful tools, the collaborative nature of this project enhanced provider-provider relationships in Western Canada. The project facilitated opportunities for providers to learn from each other, and to work together in strengthening supportive housing programs for people living with HIV.

Read more about this project, and other REACH 2.0 initiatives here.

Permalink

BC’S Work to Build Evaluation Capacity and Improve Community-Based HIV and HCV Services – REACH Significant Change Story

In BC, the Pacific AIDS Network (PAN) have been making progress on the objectives of REACH 2.0 by developing internal evaluation capacity, knowledge and skills.

Creating foundational structures and human resource expertise has allowed PAN to support other member and partner organizations’ evaluation needs. Extensive evaluation work has taken place with and on behalf of a number of BC health authorities (including Northern Health); community-based organizations; and PHAC-funded community alliances and grant holders. PAN was also able to leverage REACH’s infrastructure and to support several evaluation projects through fee-for-service contracts.  This work has created a stronger culture of evaluation in BC and has created focus and enhanced collective capacity for evidence-informed program planning and implementation especially at the level of community-based services and programs.

 To highlight this evaluation work in more depth, PAN has worked collaboratively with three different BC health authorities to build shared measurement frameworks for their community-based, contracted HIV and HCV organizations. The consistent collection of information (data) across all members of the group allowed each agency/organization to learn more about their own programming and the gains made collectively.  It also allowed the group to identify gaps and opportunities for improvement at higher levels (e.g., sectoral or geographical levels) within each health authority region. This approach allowed for a stronger network to be built among partners, which has facilitated ongoing learning and quality improvement across sectors. Evaluation data have been used to inform decision-making, improve services, and build on successful practices.

You can read more about this change story on PAN’s website.

Permalink

Shared Measurement Evaluation and Network Approach to Working Together

We have written a blog post and hosted a webinar about shared measurement evaluation framework. In continuing to share our work in this area, we are pleased to share with you a project we undertook in northern British Columbia (BC).

In 2016, Northern Health (NH) undertook a request for proposals to increase the geographic reach of community-based HIV and hepatitis C (HCV) services beyond one urban area, where most of these services had been located historically. NH provides health services to nearly 300,000 people dispersed across an area of 600,000 square kilometre in the northern two-thirds of BC. A total of $1.56M was awarded to 11 community-based not-for-profit and First Nations health organizations who now offer education, prevention/harm reduction, testing, case management, treatment and support services across the region. NH also established the HIV/HCV Specialized Support Team (SST) in effort to support and integrate primary, community and specialized services for HIV and HCV across northern BC.

NH took a unique and innovative approach by developing the Northern HIV & HCV Network (i.e. the Network) to facilitate sharing of learnings and best practices amongst the contracted organizations. The Network members included NH staff including members of the SST, and representatives from the eleven NH-contracted organizations, the First Nations Health Authority, and the Pacific AIDS Network (PAN). The Network meets on a quarterly basis to provide program updates, share information/tips, and strategize around common issues faced by NH-contracted organizations.

NH contracted PAN to develop and implement a shared measurement framework to evaluate the important work community-based organizations and the SST have conducted and the impacts they have created on their clients (e.g. in relation to quality of life and social connectedness). This evaluation also assessed the network approach to working together and built evaluation capacity of HIV/HCV community-based organizations in northern BC. A shared measurement evaluation framework was developed and data was collected using two survey tools: a survey for the NH-contracted organizations and the SST, and a client survey for people living with or at risk of acquiring HIV and/or HCV.

Key findings from this evaluation, and lessons learned from employing network approach and utilizing shared measurement framework were presented at the 2018 Canadian Association for HIV Research (CAHR) Conference. Please have a look at the Nurturing an Innovative Network in Northern British Columbia: Building Connections and Learning from a Novel Shared Measurement Evaluation poster.

Permalink

BC CBR Quarterly — CAHR 2018 Ancillary Event

The BC Community-Based Research (CBR) Quarterly Meetings (referred to as the CBR Quarterly Meetings hereon) is a community of practice that gathers three to four times a year to share learnings, challenges, and best practices related to CBR, evaluation, and knowledge translation/sharing initiatives. Meetings are organized by Pacific AIDS Network (PAN) staff, hosted by McLaren Housing Society, and attended by community members and researchers (including peers), community-based organizations, students, and academic researchers.

At the 2018 Canadian Association for HIV Research (CAHR) Conference, this diverse group held a demo, participant-observation CBR Quarterly Meeting as an ancillary event to inspire others to think about the value of peer work in research and the benefit of collaborative spaces in the uptake and integration of research findings into practice. The ultimate hope for this event was to excite others to consider modeling similar communities of practices in other regions of Canada.

So on the morning of April 26, a group of 21 participants gathered for this event. A background document outlining the history and timeline of the CBR Quarterly Meetings developed by PAN representatives was shared, demonstrating the impacts and accomplishments of this community of practice since its inception in 2010. Some of the high-level impacts shared included peer mentorship and support, networking, access to academics, capacity building, and collaborative brainstorming/problem-solving.

Peers of two CBR projects shared their experiences and perspectives, and it was incredible to document the positive impacts peer work has had on both the CBR projects and the Peer Research Associates (PRAs) themselves. PRAs from the SHAWNA Project highlighted building skills in various areas of research and meaningfully contributing to all stages of the project, while feeling well supported within their own team and also through the CBR Quarterly Meetings. Similarly, the team from the Oral History Project (that started with a community meeting, HIV in My Day: Reflecting Back, Looking Forward) emphasized the importance of embodying CBR principles from the beginning stages of CBR, allowing for a balance between academic and peer voices. PRAs from this project said they were honored to gather and listen to the stories of long-term survivors and caregivers of the early days of HIV/AIDS epidemic, and found this experience meaningful in terms of continuing to engage in the battle against HIV.

PAN staff used two CBR studies – Positive Living Positive Homes (PLPH) and The BC People Living with HIV Stigma Index Project (Stigma Index) – to showcase how CBR findings can influence programming/future work and be mobilized into action. The PLPH peer knowledge translator shared how the study findings increased people’s awareness around the important link between HIV, health, and housing; provided evidence of various advocacy efforts by PAN and partner organizations; and are being translated into useful resources and tools for people living with HIV (PLHIV) and communities (including service providers). The Stigma Index peer knowledge translator shared how the project team is using the gaps identified to inform the project’s future directions (i.e. gathering qualitative data to complement its quantitative data), and how learnings from this BC project (the first in Canada) are now being shared with/informing the national project.

Following the usual format of the CBR Quarterly Meetings the meetings participants were provided with time to network and the AHA Centre and the Dr. Peter Centre exemplified project/program updates – providing a brief summary of the program and sharing one success, one challenge, and one lesson learned. Overall, the event was well-received by the participants, who shared that BC folks know how to make CBR fun and that they are excited and inspired to go do research. The agenda and minutes from this meeting can be found here.

Permalink