Prior to starting my PhD at LSHTM, I worked at a research group based at University College London called the Rapid Research Evaluation and Appraisal Lab (RREAL). RREAL’s purpose is to improve the quality and impact of rapid research used to evaluate clinical/health models and interventions in time-sensitive contexts. As part of this, RREAL focuses on the innovate development and application of rapid methodologies. During this time, I was fortunate to work on publications commenting on the application and development of rapid methodologies and have since been invited to participate in an e-Delphi study for the development of standards in rapid evaluation and appraisal methods.
What is rapid evaluation?
Let me start by distinguishing between “rushed” and “rapid” research (Fitch et al., 2000; Manderson & Aaby, 1992; Vindrola-Padros, 2021). Rapid research is not intended as a tool to cut corners which may violate the quality or ethical standards of research, as a solution to lack of resources, or to be haphazardly applied as suits without engaging with new methodologies or techniques in a meaningful and purposeful manor (Vindrola-Padros, 2021; Vindrola-Padros and Johnson, 2020). To quote Robert Chambers, rapid approaches could be:
“…to over-sold, too rapidly adopted, badly done, and then discredited, to suffer an underserved, premature burial as has occurred with other innovative research practices” (Chambers, 1991, p351).
For those new to rapid methods, there is no set duration at which the line is drawn between short-form (rapid) and long-form research. As with many things, this would be a widely unhelpful and reductive definition. For instance, two studies might both have taken a duration of 6 months. In study one, the study was not under any obvious time-pressures and no deviations were required from typical long-form approaches to complete the study within the 6-month period. Comparatively, in study two, producing the study within the 6-month period was a highly intensive process which required selecting dynamic and iterative rapid research methodology to facilitate timely delivery.
Hence, rapid research is defined not by duration, but by a distinct set of methodological principles which seek to enable timeliness while maintaining scientific rigor. At times the lines between long-form and rapid research can become blurred, when seemingly long-term projects include sequences of short periods of data collection and analysis, forming ‘cycles’ within the research duration; this is particularly true of rapid evaluations (McNall et al., 2004; Vindrola-Padros et al., 2021). Methodological adaptions for rapid research are diverse, but there are a couple which tend to be core features across studies irrespective of discipline. To quote Beebe’s definition of rapid qualitative research:
‘…intensive, team-based qualitative enquiry with (a) a focus on the insider’s or emic perspective, (b) using multiple sources and triangulation, and (c) using iterative data analysis and additional data collection to quickly develop a preliminary understanding of a situation’ (2014, p3).
Rapid evaluation was born as an off-shoot to mainstream rapid methodologies in response to anthropologists partnering with multilateral and local government agencies (McNall and Foster-Fishman, 2007). Rapid evaluations are different from other rapid qualitative approaches because they are specifically designed to assess the impact or document the implementation of specific interventions, services, or programmes. Common approaches include rapid evaluation methods (REM), rapid feedback evaluation (RFE), and rapid cycle evaluation (RCE) (Vindrola-Padros et al., 2020; Chisnall et al., 2023). These approaches are compatible with quantitative, qualitative, or mixed methods approaches.
Rapid evaluation offers a tremendous opportunity to conduct timely and impactful research in time-sensitive settings. For anyone interested in learning more about the opportunities and challenges of rapid evaluation, I would encourage you to either attend RREAL’s course titled ‘Introduction to Rapid Evaluation’ or to read some of the publications listed below. I would be interested to hear of any rapid evaluations taking place at LSHTM and am happy to answer any questions so do get in touch - (georgia.chisnall@lshtm.ac.uk).
Recommended reading
- McNall, M., & Foster-Fishman, P. G. (2007). Methods of rapid evaluation, assessment, and appraisal. American journal of evaluation, 28(2), 151-168.
- Vindrola-Padros, C., Brage, E., & Johnson, G. A. (2021). Rapid, responsive, and relevant?: A systematic review of rapid evaluations in health care. American Journal of Evaluation, 42(1), 13-27.
References (not listed above)
- Beebe, J. (2014). Rapid qualitative inquiry: A field guide to team-based assessment. Rowman & Littlefield.
- Chambers, R. (1997). Shortcut and participatory methods for gaining social information for projects. Inter-American Institute for Co-operation on Agriculture.
- Chisnall, G., Kumpunen, S., & Vindrola, C. (2023). Rapid qualitative research. Elsevier.
- Fitch, C., Rhodes, T., Stimson, G., 2000. Origins of an epidemic: the methodological and political emergence of rapid assessment. Int. J. Drug Pol. 11, 63–82
- Manderson, L., & Aaby, P. (1992). An epidemic in the field? Rapid assessment procedures and health research. Social science & medicine, 35(7), 839-850.
- McNall, M., Welch, V., Ruh, K., Mildner, C., Soto, T., 2004. The use of rapid-feedback evaluation methods to improve the retention rates of an HIV/AIDS healthcare intervention. Eval. Progr. Plann. 27, 287–294.
- Vindrola-Padros, C., 2020. Can we Re-imagine research so it is timely, relevant and responsive? Comment on “experience of health leadership in partnering with University-based researchers in Canada: a call to ‘Re-imagine’ research”. Int. J. Health Pol. Manag.
LSHTM's short courses provide opportunities to study specialised topics across a broad range of public and global health fields. From AMR to vaccines, travel medicine to clinical trials, and modelling to malaria, refresh your skills and join one of our short courses today.