Effects in spite of tough constraints - A theory of change based investigation of contextual and implementation factors affecting the results of a performance based financing scheme extended to malnutrition in Burundi

Autoři: Manassé Nimpagaritse aff001;  Catherine Korachais aff002;  Bruno Meessen aff002
Působiště autorů: Institut National de Santé Publique, Bujumbura, Burundi aff001;  Health Economics Unit, Department of Public Health, Institute of Tropical Medicine, Antwerp, Belgium aff002;  Institut de Recherche Santé et Société, Université Catholique de Louvain, Clos Chapelle-aux-Champs, Bruxelles, Belgique aff003
Vyšlo v časopise: PLoS ONE 15(1)
Kategorie: Research Article
doi: https://doi.org/10.1371/journal.pone.0226376



From January 2015 to December 2016, the health authorities in Burundi piloted the inclusion of child nutrition services into the pre-existing performance-based financing free health care policy (PBF-FHC). An impact evaluation, focused on health centres, found positive effects both in terms of volume of services and quality of care. To some extent, this result is puzzling given the harshness of the contextual constraints related to the fragile setting.


With a multi-methods approach, we explored how contextual and implementation constraints interacted with the pre-identified tracks of effect transmission embodied in the intervention. For our analysis, we used a hypothetical Theory of Change (ToC) that mapped a set of seven tracks through which the intervention might develop positive effects for children suffering from malnutrition. We built our analysis on (1) findings from the facility surveys and (2) extra qualitative data (logbooks, interviews and operational document reviews).


Our results suggest that six constraints have weighted upon the intervention: (1) initial low skills of health workers; (2) unavailability of resources (including nutritional dietary inputs and equipment); (3) payment delays; (4) suboptimal information; (5) restrictions on autonomy; and (6) low intensity of supervision. Together, they have affected the intensity of the intervention, especially during its first year. From our analysis of the ToC, we noted that the positive effects largely occurred as a result of the incentive and information tracks. Qualitative data suggests that health centres have circumvented the many constraints by relying on a community-based recruitment strategy and a better management of inputs at the level of the facility and the patient himself.


Frontline actors have agency: when incentives are right, they take the initiative and find solutions. However, they cannot perform miracles: Burundi needs a holistic societal strategy to resolve the structural problem of child malnutrition.

Trial registration

Clinical Trials.gov Identifier: NCT02721160; March 2016 (retrospectively registered).

Klíčová slova:

Burundi – Finance – Health care policy – Health economics – Malnutrition – Nutrition – Payment – Supervisors


1. Fritsche GB, Soeters R, Meessen B. Performance-Based Financing Toolkit. 2014.

2. Renmans D, Holvoet N, Criel B, Meessen B. Performance-based financing: The same is different. Health Policy Plan. 2017;

3. Witter S, Toonen J, Meessen B, Kagubare J, Fritsche G, Vaughan K. Performance-based financing as a health system reform: mapping the key dimensions for monitoring and evaluation. BMC Health Serv Res [Internet]. 2013;13:367. Available from: http://www.ncbi.nlm.nih.gov/pubmed/24073625%5Cnhttp://www.ncbi.nlm.nih.gov/pmc/articles/PMC3849795/pdf/1472-6963-13-367.pdf doi: 10.1186/1472-6963-13-367 24073625

4. Renmans D, Holvoet N, Orach CG, Criel B. Opening the “black box” of performance-based financing in low- and lower middle-income countries: A review of the literature. Health Policy and Planning. 2016.

5. Lohmann J, Houlfort N, De Allegri M. Crowding out or no crowding out? A Self-Determination Theory approach to health worker motivation in performance-based fi nancing. Soc Sci Med. Elsevier Ltd; 2016;169:1–8.

6. Meessen B, Musango L, Kashala JPI, Lemlin J. Reviewing institutions of rural health centres: The Performance Initiative in Butare, Rwanda. Trop Med Int Heal. 2006;11(8):1303–17.

7. Meessen B. " An institutional economic analysis of public health care organisations in low-income countries " Référence bibliographique PhD in Economics Département des Sciences Economiques. Thèse(dissertation). 2009.

8. Meessen B, Soucat A, Sekabaraga C. Performance-based financing: just a donor fad or a catalyst towards comprehensive health-care reform? Bull World Heal Organ. 2011;89(November 2010):153–6.

9. Aoki M. Endogenizing Institutions and Institutional Changes ★. J Institutional Econ. 2007;3:1–39.

10. Paina L, Peters DH. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 2012;

11. Binyaruka P, Patouillard E, Powell-Jackson T, Greco G, Maestad O, Borghi J. Effect of paying for performance on utilisation, quality, and user costs of health services in Tanzania: A controlled before and after study. PLoS One. 2015;

12. Basinga P, Gertler PJ, Binagwaho A, Soucat ALB, Sturdy J, Vermeersch CMJ. Eff ect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet. Elsevier Ltd; 2011;377(9775):1421–8. doi: 10.1016/S0140-6736(11)60177-3 21515164

13. Brenner S, Wilhelm D, Lohmann J, Kambala C, Chinkhumba J. Implementation research to improve quality of maternal and newborn health care, Malawi. Bull World Health Organ. 2017;95(December 2016):491–502. doi: 10.2471/BLT.16.178202 28670014

14. Bertone MP, Falisse J-B, Russo G, Witter S. Context matters (but how and why?) A hypothesis-led literature review of performance based financing in fragile and conflict-affected health systems. PLoS One. 2018;13(4):1–27.

15. Bertone MP, Jacobs E, Toonen J, Akwataghibe N, Witter S. Performance-based financing in three humanitarian settings: Principles and pragmatism. Confl Health. 2018;

16. Bertone MP, Wurie H, Samai M, Witter S. The bumpy trajectory of performance-based financing for healthcare in Sierra Leone: Agency, structure and frames shaping the policy process. Global Health. 2018;

17. Lohmann J, Wilhelm D, Kambala C, Brenner S, Muula AS, De Allegri M. “The money can be a motivator, to me a little, but mostly PBF just helps me to do better in my job.” An exploration of the motivational mechanisms of performance-based financing for health workers in Malawi. Health Policy Plan. 2018;

18. Borghi J, Singh NS, Brown G, Anselmi L, Kristensen S. Understanding for whom, why and in what circumstances payment for performance works in low and middle income countries: protocol for a realist review. BMJ Glob Heal. 2018;

19. Messner JJ. Fragile States Index 2016. The Fund for Peace. 2016.

20. World Bank. Burundi overview. 2018;

21. PNUD. Perspectives de croissance de l’économie burundaise et analyse du budget 2017 de l’État. Note Tech. 2017;

22. World Bank. World development indicators 2015. In 2016.

23. MoH. National Health Development Plan 2011–2015. 2011;

24. Nimpagaritse M, Bertone MP. The sudden removal of user fees: The perspective of a frontline manager in Burundi. Health Policy and Planning. 2011.

25. Bertone MP, Meessen B. Studying the link between institutions and health system performance: A framework and an illustration with the analysis of two performance-based financing schemes in Burundi. Health Policy Plan. 2013;

26. Rudasingwa M, Soeters R, Bossuyt M. The Effect of Performance-Based Financial Incentives on Improving Health Care Provision in Burundi: A Controlled Cohort Study. Glob J Health Sci. 2015;7(3):15–29.

27. Rudasingwa M, Soeters R, Basenya O. The effect of performance-based financing on maternal healthcare use in Burundi: A two-wave pooled cross-sectional analysis. Glob Health Action. 2017;

28. Basenya O, Nimpagaritse M, Busogoro F, Ndayishimiye J, Nkunzimana C, Ntahimpereye G, et al. Le financement basé sur la performance comme stratégie pour améliorer la mise en œuvre de la gratuité des soins: premières leçons de l’expérience du Burundi. PBF CoP Work Pap. 2011;1–17.

29. ISTEEBU I de S et d’Etudes E du B, MSPLS M de la SP et de la L contre le S, ICF I. Burundi. Enquête Démographique Santé Burundi 2010. 2012;

30. Falisse J-B, Ndayishimiye J, Kamenyero V, Bossuyt M. Performance-based financing in the context of selective free health-care: an evaluation of its effects on the use of primary health-care services in Burundi using routine data. Health Policy Plan. 2015;30(10):1251–60. doi: 10.1093/heapol/czu132 25533992

31. Bonfrer I, Van de Poel E, Van Doorslaer E. The effects of performance incentives on the utilization and quality of maternal and child care in Burundi. Soc Sci Med. 2014;

32. Bonfrer I, Soeters R, Van de Poel E, Basenya O, Gashubije L, van de Looij F, et al. Introduction Of Performance-Based Financing In Burundi Was Associated With Improvements In Care And Quality. Health Aff. 2014;12.

33. Peerenboom PB, Basenya O, Bossuyt M, Ndayishimiye J, Ntakarutimana L, Van de Weerd J. La bonne gouvernance dans la réforme du financement du système de santé au Burundi. Sante Publique (Paris). 2014;26:229–40.

34. Rudasingwa M, Uwizeye MR. Physicians’ and nurses’ attitudes towards performance-based financial incentives in Burundi: A qualitative study in the province of Gitega. Glob Health Action. 2017;

35. Nimpagaritse M, Korachais C, Roberfroid D, Kolsteren P, Driss M, Eddine Z, et al. Measuring and understanding the effects of a performance based financing scheme applied to nutrition services in Burundi—a mixed method impact evaluation design. BMC Int J Equity Heal. International Journal for Equity in Health; 2016;15(93):1–11.

36. Korachais C, Nkurunziza S, Nimpagaritse M, Meessen B. FBP Nutrition au Burundi: Evaluation d’impact au niveau des centres de santé et des ménages. Inst Médecine Trop d’Anvers, Belgique. 2018;

37. Korachais C, Nkurunziza S, Nimpagaritse M, Meessen B. Impact of the extension of a performance based financing scheme to nutrition services in Burundi–a cluster-randomized control trial. Forthcoming. 2019;

38. Ritchie J, Lewis J. QUALITATIVE RESEARCH PRACTICE A Guide for Social Science Students and Researchers. 2003.

39. EU C. DÉCISION DU CONSEIL relative à la conclusion de la procédure de consultation avec la République du Burundi au titre de l’article 96 de l’accord de Cotonou. 2016;

40. Nimpagaritse M, Korachais C, Nsengiyumva G, Macq J, Meessen B. Addressing the burden of malnutrition among children under five years: how is the community—based management of acute malnutrition strategy implemented at health centre level in Burundi? Forthcoming. 2019;

41. Nimpagaritse M, Korachais C, Nsengiyumva G, Macq J, Meessen B. Addressing malnutrition among children in routine care: how is the Integrated Management of Childhood Illnesses strategy implemented at health centre level in Burundi? BMC Nutr [Internet]. 2019;5(22). Available from: https://doi.org/10.1186/s40795-019-0282-y

42. MSPLS. Manuel des Procédures pour la mise en oeuvre du financement basé sur la performance au Burundi Version révisée 2. 2014;

43. MSPLS. Rapport de mise en oeuvre du inancement basé sur la performance et la gratuité des soins pour l’année 2015. 2016;

44. MSPLS. Rapport de mise en oeuvre du financement basé sur la performance associé à la gratuité des soins pour l’année 2016. 2017;

45. MSPLS. Rapport de contre vérification des données quantitatives et qualitatives pour le financement basé sur la performance: IIième semestre 2016. 2017.

46. Anselmi L, Binyaruka P, Borghi J. Understanding causal pathways within health systems policy evaluation through mediation analysis: An application to payment for performance (P4P) in Tanzania. Implement Sci. 2017;

47. Renmans D, Holvoet N, Criel B. Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the ‘ Black Box ‘ of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda. Int J Environ Res Public Health. 2017;14(9).

48. Paul E, Lamine Dramé M, Ndema AE, Kounnou M, Kashala JP, Aïssan JC, et al. Performance-Based Financing to Strengthen the Health System in Benin: Challenging the Mainstream Approach. Int J Heal Plan Manag. 2018;7(1):35–47.

49. Brenner S, Muula AS, Robyn PJ, Bärnighausen T, Sarker M, Mathanga DP, et al. Design of an impact evaluation using a mixed methods model—An explanatory assessment of the effects of results-based financing mechanisms on maternal healthcare services in Malawi. BMC Health Serv Res. 2014;

50. De Allegri M, Bertone MP, McMahon S, Chare IM, Robyn PJ. Unraveling PBF effects beyond impact evaluation: results from a qualitative study in Cameroon. BMJ Glob Heal. 2018;3.

51. Olafsdottir AE, Mayumana I, Mashasi I, Njau I, Mamdani M, Patouillard E, et al. Pay for performance: an analysis of the context of implementation in a pilot project in Tanzania. BMC Health Serv Res. 2014;14.

52. Ridde V, Somé PA, Yaogo M, Marie A, Tremblay T. Twelve months of implementation of health care performance ‐ based financing in Burkina Faso: A qualitative multiple case study. Int J Heal Plan Manag. 2018;33:e153–67.

53. Dale EM. Performance-based payment, provider motivation and quality of care in Afghanistan. 2014.

54. Shen GC, Nguyen HTH, Das A, Sachingongu N, Chansa C, Qamruddin J, et al. Incentives to change: effects of performance-based financing on health workers in Zambia. Hum Resour Health. Human Resources for Health; 2017;15(20):1–15.

55. Bhatnagar A, George AS. Motivating health workers up to a limit: Partial effects of performance-based financing on working environments in Nigeria. Health Policy Plan. 2016;

56. Antony M, Bertone MP, Barthes O. Exploring implementation practices in results-based financing: The case of the verification in Benin. BMC Health Serv Res. 2017;

57. Ogundeji YK, Jackson C, Sheldon T, Olubajo O, Ijebuzor N. Pay for performance in Nigeria: the influence of context and implementation on results. Health Policy Plan. 2016;31(8):955–63. doi: 10.1093/heapol/czw016 27036415

58. Bertone MP, Lagarde M, Witter S. Performance-based financing in the context of the complex remuneration of health workers: Findings from a mixed-method study in rural Sierra Leone. BMC Health Serv Res. 2016;

59. Fox S, Witter S, Wylde E, Mafuta E, Lievens T. Paying health workers for performance in a fragmented, fragile state: Reflections from Katanga Province, Democratic Republic of Congo. Health Policy Plan. 2014;

60. Kalk A, Paul FA, Grabosch E. ‘ Paying for performance ‘ in Rwanda: does it pay off? Trop Med Int Heal. 2010;15(2):182–90.

61. Midgley G. Systemic intervention for public health. American Journal of Public Health. 2006.

62. Mckim CA. The Value of Mixed Methods Research: A Mixed Methods Study. J Mix Methods Res. 2017;11(2):202–22.

63. Bertone MP, Jacobs E, Toonen J, Akwataghibe N, Witter S. Performance-based financing in three humanitarian settings: principles and pragmatism. BMC Conlict Heal. Conflict and Health; 2018;12(28):1–14.

64. Paola Bertone M, Falisse JB, Russo G, Witter S. Context matters (but how and why?) A hypothesis-led literature review of performance based financing in fragile and conflict-affected health systems. PLoS One. 2018;

65. Kane S, Gandidzanwa C, Mutasa R, Moyo I, Sismayi C, Mafaune P, et al. Coming Full Circle: How Health Worker Motivation and Performance in Results-Based Financing Arrangements Hinges on Strong and Adaptive Health Systems. Int J Heal Policy Manag. 2019;8(2).

66. OECD. States of Fragility 2016: Understanding violence. 2016.

67. Woodward A, Sheahan K, Martineau T, Sondorp E. Health systems research in fragile and conflict affected states: A qualitative study of associated challenges. Heal Res Policy Syst. 2017;15.

Článek vyšel v časopise


2020 Číslo 1
Nejčtenější tento týden