International Collaboration  For Participatory Research
  • Home
  • About
    • Goals and Objectives
    • Structure
  • News
  • Getting Involved
    • Endorsing Members >
      • Endorsing Members
      • Members' videos >
        • Upcoming
    • Annual Meeting >
      • AWM 2022: Huelva, Spain
      • AWM 2021: Virtual
      • AWM 2020: Virtual
      • AWM 2019: Baltimore >
        • AWM 2019: Baltimore
        • Pre-conference 2019
      • AWM 2018: Edmonton >
        • AWM 2018: Edmonton >
          • AWM 2018: Meeting Minutes
        • Pre-conference 2018
      • AWM 2017: Ireland >
        • AWM 2017: Ireland
        • Meeting Minutes AWM 2017
        • Pre-conference 2017 >
          • Pre-conference registration
      • AWM 2016: Malmö >
        • AWM 2016: Malmö
        • Pre-conference 2016
      • AWM 2015: Berlin >
        • AWM 2015: Berlin
        • AWM 2015: Meeting Minutes
        • PHOTOS: AWM 2015
        • Pre-conference
      • AWM 2014: Niteroi >
        • Pre-meeting event
      • AWM 2013: Northumbria
      • AWM 2012: Coimbra
      • AWM 2011: Toronto
      • AWM 2010: Berlin
    • Focus Areas: Overview >
      • Ethics in Participatory Health Research
      • Evaluation of Participatory Health Research
      • Interactive Knowledgebase and Impact
      • Kids in Action >
        • 'Kids in Action' Initiative Registration
        • Manifesto of Values
        • Project Summaries: Updated Sept 2019
        • Helpful Links and Resources
      • Literature Reviews
      • Theories and Methodologies of PHR
      • Training in Participatory Health Research
    • Projects
    • PHR Courses Around the World >
      • PPI/PHR Courses
      • ICPHR International Course
  • Resources
    • ICPHR Resources
    • Position Papers & Discussion Papers
    • Reviews
    • Members Publications
  • Networks
    • Colaboracion Internacional por la Investigacion Participativa en Salud
    • Netzwerk Partizipative Gesundheitsforschung - PartNet
    • UK Participatory Research Network
  • Contact Us
  • New Page

Evaluation of Participatory Health Research

Project Lead:  Prof. Laudette Jones, Department of Epidemiology and Public Health, University of Maryland

The UNM Center for Participatory Research will provide leadership and methodologic expertise on the development and implementation of qualitative and quantitative methods for evaluating Participatory Health Research Projects.  This includes either leading or collaborating on evaluation designs, questions, methods, and measures on the various dimensions of PHR evaluation:  1) the local and national contexts that inform and shape PHR project(s),  2) the type and extent of partnering practices, 3) the impacts of participation on the research and knowledge creation process, and 4) the range of outcomes/impacts of PHR. 

If you would like to design or conduct a PHR evaluation with ICPHR partners or that reflect ICPHR goals; develop a review of evaluation protocols, validity issues or other dimensions of PHR evaluation; or have a manuscript/concept paper on PHR evaluation issues to post, please send an email to Nina Wallerstein, project lead.

Background Framework: 
Through evaluation strategies, we seek to understand the added value and benefit of participatory practices for improving health outcomes.  We seek to know which practices contribute to effective academic-community (and other stakeholder) partnerships, and what are the facilitators and barriers to this effectiveness.  We seek to know the range of outcomes or impacts participatory health research can influence, whether they are specific research outcomes, greater community capacities, or greater capacities of academic institutions to engage in partnership with community.

Evaluation, just like every other aspect of participatory health research, does not take place in a vacuum.  Each partnership exists within a local and national context, including political and socio-economic trends; cultural values and knowledge; histories of trust or mistrust based on previous research relationships; and whether or not the problem chosen is a priority within the community.  Participatory practices are also complex and are based on relationships as well as structural agreements or mutually accepted guidelines for engagement.

Core Evaluation Questions:
The core evaluation question therefore is: “under what conditions, do which participatory strategies, contribute to what kind of outcomes?”   

Many sets of questions fall under this key question. Examples include: 
  • What context characteristics are facilitators of PHR? 
  • What characterizes effective and authentic community participation in PHR?
  • What does it mean to community members to participate in PHR?
  • How can the Wallerstein conceptual model be applied and tested? Is it useful?
  • What impact does PHR have on the policy process?
  • Does PHR expedite the translation to policy and practice?
  • How can we attribute the changes that we see to the work that we’re doing?  or is this contribution?
  • How can the unique contributions of each project be valued?
  • How do different groups /stakeholders see impact of PHR?
  • How can you evaluate an essentially dialectical messy process? What methods of knowledge creation will be most helpful?
  • How can we evaluate the extent of the diverse validities which are part of PHR? participatory validity, intersubjective validity, contextual validity, catalytic validity, ethical validity, or empathic validity ?
  • How do you scale up interventions, when context and re-centering to the context always is part of the PHR process? 
Existing PHR evaluations: 

Belone, L., Lucero, JE., Duran, B., Tafoya, G., Baker, EA., Chan, D., Chang, C., Greene-Moton, E., Kelley, M., Wallerstein, N. Community-Based Participatory Research Conceptual Model: Community Partner Consultation and Face Validity, Qualitative Health Research, published online 31 October 2014, DOI: 10.1177/1049732314557084.

Hicks S, Duran B, Wallerstein N, Avila M, Belone L, Lucero J,,Magarati, M., Mainer, E., Muhammad, M., Oetzel, J., Pearson, C., Sahota, Pl, Simonds, V., Sussman, A., Tafoya, G., White Hat, E., Evaluating community-based participatory research to improve community-partnered science and community health. Progress in Community Health Partnerships: Research, Education, and Action 2012; 6(3): 289-99.

Lucero JE, Wallerstein N. Trust in community-academic research partnerships: Increasing the consciousness of conflict and trust development. In: Ting-Toomey S, Oetzel J, editors. Sage Conflict of Communications. 2nd ed. Thousand Oaks, CA: Sage Publications; 2013. p. 537-563.

Oetzel JG, Villegas M, Zenone H, White Hat E, Wallerstein, N., Duran, B. Governance of community-engaged research: Exploring the associations of final approval with processes and outcomes. American Journal of Public Health, in press.

Oetzel, J., Zhou, C., Duran, B., Pearson, C., Magarati, M., Wallerstein, N. Establishing the Psychometric Properties of Constructs in a Community-Based Participatory Research Conceptual Model, American Journal of Health Promotion; published first on-line, 2014, DOI: 10.4278/ajhp.130731-QUAN-398.

Pearson C.R, Duran, B., Magarati, M., Oetzel, J., Zhou, C., Lucero, J., Villegas, M., Wallerstein, N. (2015) “Research for Improved Health: Variability and Impact of Structural Characteristics in Federally- funded Community Engaged Research Studies.” Progress in Community Health Partnerships: Research, Education, and Action 9 (1).

Sandoval, JA, Lucero, J; Oetzel, J; Avila, M; Belone, L; Mau, M; Pearson, C., Tafoya, G; Duran, B., Rios, LI, Wallerstein, N., Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Education Research 2012;27(4):680-690.

Wallerstein N, Oetzel J, Duran B, Belone L, Tafoya G, Rae R. What predicts outcomes in CBPR? In: Minkler M, Wallerstein N, editors. Community Based Participatory Research for Health: From Process to Outcomes. 2nd ed. San Francisco: Jossey-Bass; 2008. p. 371-392.

Home
About
News
Getting Involved
Resources
Networks
Contact Us



The contents of this site are licensed under the Creative Commons "Attribution-NonCommercial-ShareAlike 3.0" Licence