How to Measure ‘Effectiveness’ of Programs?

What is Effectiveness?

  • Simply, effectiveness means achieving the desired/targeted result.
  • Effectiveness is about doing the right things, completing activities and achieving goals.
  • Effectiveness is the ability to accomplish a purpose and produce an intended result.
  • Being effective means producing better and higher degree of success.

What is Effectiveness of Programs?

  • Effectiveness of programs relates to the level by which the activities of program produces the desired effect.
  • It is the magnitude of targeted result achieved from the program.

For more details, please refer to: https://publichealthnotes.com/differences-effectiveness-efficiency/

What Do We Mean by Ensuring Effectiveness Of Programs?

  • Ensuring effectiveness of the program means ensuring that the program is on the right track in a productive manner.
  • It also means measuring the extent to which targets are met.

Components of Effectiveness:

1. Decentralized Decision-making

  • Decision-making should not be autonomous for the effectiveness of any program or organization.
  • Decentralized decision-making leads to sharing opinion on all levels of staff, which promotes teamwork and effort.

2. Empowerment of employees

  • Empowerment plays a great role in the effectiveness of the program because it allows employees to be innovative and think beyond their capacity in a decentralized structure.
  • It allows them to work towards common goals despite their differences.

3. Political stability

  • Political commitment by the leaders helps to obtain resources and support for effective action.

4. Communication

  • Timely information and accurate communication skills to the respective staff, decision makers increase the effectiveness of a program.

5. Performance management

  • Rigorous, real-time monitoring, evaluation, and program improvement increase effectiveness.

6. Partnership and collaboration with multiple sectors and stakeholders

7. Innovation in programs

How Can We Measure Effectiveness of Any Programs?

There are different methods to measure/assess the effectiveness of any programs. They are:

1. Using certain evaluation questions to address ‘effectiveness’:

  • According to Peersman, 2014, there are certain set of questions which can be asked to address the effectiveness of programs.
  • These questions are either ‘meso level’ or ‘micro level’ questions.
  • The major questions to address effectiveness include:
    • Was the intervention implemented according to the plan?
    • Was timely corrective action taken where necessary?
    • Were intended results achieved?

Examples of meso and micro level evaluation questions to address ‘effectiveness’:

Source: Peersman, 2014

2. Program evaluation:

We can measure the effectiveness of any programs through different program evaluation methods. These program evaluation methods include:

a) Annual review

  • Annual review refers to the evaluation of any program’s effectiveness and annual performance of a year.
  • It is usually a systematic, objective and impartial evaluation of the effectiveness of any programs.
  • It provides the overall impact of the program in the given year and helps to identify the strengths, weaknesses, opportunities and challenges.

b) Mid-term evaluation

  • Mid-term evaluation is conducted for an ongoing program or project.
  • A mid-term review is done halfway through the implementation of any program.
  • Mid-term evaluation can be useful when a number of activities are carried out.
  • It identifies any weakness in the implemented program and correction be made when there is still time to recover

c) Final evaluation

  • Final evaluation is done at the end or near to end of the program to ensure that the objectives and targets are achieved.
  • It determines the extent to which the planned objectives were achieved
  • It also identifies the factors responsible for the success or failure of any programs
  • It also assesses the sustainability of the program and the benefits
  • It provides evidence and information for future policy and program planners

d) Ex-post evaluation

  • Ex-post evaluation generally conducted until three years, after the project completion with the emphasis on the effectiveness and sustainability of the project.
  • This evaluation aims at deriving lessons learned and recommendations to improve the project as well as to help plan and implement more effective and efficient projects.

References and For More Information:

https://ajph.aphapublications.org/doi/abs/10.2105/AJPH.2013.301608?journalCode=ajph

https://www.hrbartender.com/2017/employee-engagement/5-components-performance-management/

https://developingchild.harvard.edu/resources/inbrief-early-childhood-program-effectiveness/

https://46y5eh11fhgw3ve3ytpwxt9r-wpengine.netdna-ssl.com/wp-content/uploads/2015/05/inbrief-programs-update-1.pdf

https://www.usaid.gov/evaluation/usaid-program-effectiveness

https://nrsweb.org/sites/default/files/Planning-Guide-508.pdf

https://www.who.int/roadsafety/projects/manuals/alcohol/4-How%20to.pdf

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3437184/

https://www.unicef-irc.org/publications/pdf/brief_3_evaluativecriteria_eng.pdf

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3910052/

 

About Kusum Wagle 214 Articles
Hello and greetings everyone! I am Kusum Wagle, MPH, WHO-TDR Scholar, BRAC James P. Grant School of Public Health, Bangladesh. I have gained profound experiences in public health sector under different thematic areas of health, nutrition, sexual and reproductive health, maternal and newborn health, research etc., targeting diverse audience of different age groups. I have performed diverse roles ranging from lecturer in the public health department of colleges, nutrition coordinator, research coordinator and consultant, in different programs, projects and academic institutions of Nepal. I also hold immense experience in working closely and persistently with government organizations, non-government organizations, UN agencies, CSOs and other stakeholders at the national and sub-national level. I have successfully led and coordinated different projects involving multi-sector participation and engagement. Moreover, I am also regularly involved in the development of different national health related programs and its guidelines.