An evaluation is a purposeful, systematic, and careful collection and analysis of information used for the purpose of documenting the effectiveness and impact of programs, establishing. Programme operations, unicef, new york, revised may 2003, pp. A generic programme logic model ministry of health. Many people believe evaluation is a useless activity that generates lots of boring data with useless conclusions. Educational evaluation models were not developed with education theories in mind. The relationships among program components are usually represented in a logic model by arrows that show. References to program evaluation methods frequently include the phrase qualitative and quantitative methods, as if the mention of one method demands the inclusion of the other. Also, beyond covering both creditable and noncreditable approaches, some authors of evaluation approaches say that the term model. Models of curriculum evaluation university of kwazulunatal. Evaluation literally means the assessment of value or worth. Additional resources developing evaluation questions. There are many models of evaluation that can be used to evaluate a program. Program evaluation can include any or a variety of at least 35 different types of evaluation, such as for needs assessments, accreditation, costbenefit analysis, effectiveness, efficiency, formative, summative, goal. Program evaluation models and related theories unc school of.
Cipp evaluation model developed by stufflebeam and shinkfield in 1985. Stufflebeams ipp evaluation model defining evaluation. A program evaluation is conducted every three to five years for our longterm community development programs, and every year to two years for our grantfunded projects, to measure change over time. Evaluation measures the extent to which programs, processes, or tools achieve the. Two of the approaches, reflecting the political realities of evaluation, are often used illegitimately to falsely characterize a program s value and are labeled pseudo. An evaluation framework for community health programs can be used by communitybased organizations and community health workers to enhance their understanding of evaluation and to build their capacity to more actively and aggressively participate in evaluation efforts of their programs. The assessment of the evaluation model metaevaluation is a critical step in evaluation, as it is at the basis of a successful program project evaluation. Application of context input process and product model in. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model s theoretical basis against their programs complexity and their own evaluation needs. These models establish the evaluation purposes, strategies, activities, and the people that participate in the assessment process, as well as method choices, and roles and responsibilities of. Project and programme evaluations guidelines 1 evaluation. Major types of program evaluation evaluating program processes, goals, outcomes.
Framework for program evaluation in public health cdc pdf mmwr 1999. Evaluating educational programs yael fisher achva academic college, telaviv 69121, israel abstract. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. Purposes can range from a mechanical compliance with a funders reporting requirements, to the genuine desire by program managers and stakeholder to learn are we making a difference. Formative evaluation ensures that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented. Gfe, in program evaluation, is a model in which the official or stated program goals and objectives are withheld or screened from the evaluator. Models are linear, programs are complex, interactive models are static, programs may change over time. Models of program evaluation many evaluation models were developed in the 1970s and 1980s. Evaluation models and approaches the following models and approaches are frequently mentioned in the evaluation literature. Jan 20, 2016 learning evaluation models you will find useful there are dozens of learning evaluation models currently in practice.
The research regarding programs and project evaluation models developed. It concludes by propos ing a comprehensive and eclectic process that can be used to evaluate a field of study, which is perhaps the most difficult curricular element that evaluators face. Evaluation models for evaluating educational programs. Glynn sharpe nipissing university 100 college drive box 5002, north bay, ontario canada abstract the paper explores and defines what program theory entails and when and why it is appropriate to develop a program theory. Models may not take unexpected consequences into account models may not account for conflict, power, control issues theory or model assumes the model is correct. Once youve determined which program activities in your logic model should be. The systematic and objective assessment of an ongoing or completed project or programme, its design, implementation and results. Basic guide to program evaluation including many additional. There are several types of evaluations that can be conducted. Developing and implementing such an evaluation system has many benefits including helping you to. Context evaluation input evaluation process evaluation product evaluation these components are or can be viewed as separate forms of evaluation, but they can also be viewed as steps or stages in a comprehensive evaluation. Program evaluation methods treasury board of canada. The breadth of an evaluation will always be limited by the resources available, but note that a welldesigned, simple evaluation can be as powerful as a more complex and costly one.
Many timehonored evaluation models remain available for that limited but important purpose. Making evaluation an integral part of your program means evaluation is a part of everything you do. Rr11 overview of the framework cdc pdf provides 3page key points from framework. The guide describes a generic programme logic model and checklist that are designed to guide people through the steps of developing a thorough public health programme. These approaches, in varying degrees, are unique and cover most program evaluation efforts. It would simply mean the act of judging whether or not the activity to be evaluated is worthwhile in terms of set criteria. One purpose of conducting a theorybased evaluation is to test the model hypothesized to explain the program and. Example of logic models use in evaluation planning. Training evaluation ensures that whether candidates are able to.
You design your program with evaluation in mind, collect data on an ongoing basis, and use these data to continuously improve your program. You can think of evaluation designs in three main categories. The model described and recommended in this manual is based on the projectprogramme cycle, which depicts the management of an intervention through a sequence of inter. Using programme theory to evaluate 33 the remainder of the article presents and discusses examples of programme theory evaluations that address each of these issues through the type of logic model developed and how it was used for the evaluation. Projectprogramme monitoring and evaluation guide 2. Dms 53855 programdevelopment evaluation model fact sheet1. The aim is to determine the relevanc e and fulfillment of objectives, development efficiency, effectiveness, impact and sustainability. Program evaluation models and related theories amee guide. Evaluating and improving criminal justice training final report september 2007 submitted to national institute of justice prepared by kelly bradley edward connors institute for. Table 2 considerations in developing credible evaluations.
Logic models can be useful planning tools during this phase. Basic guide to program evaluation university of new mexico. Bdi logic models can also improve the evaluation of community programs and initiatives. Evaluating and improving criminal justice training final report september 2007 submitted to national institute of justice prepared by kelly bradley edward connors institute for law and justice. Know what a logic model is, and how it can be useful to your daily program operations identify the key components of a logic model. Using programme theory to evaluate complicated and. Using programme theory to evaluate 31 this distinction seemed to provide a particularly useful orienting framework for evaluation patton, 2003 and has obvious implications for programme theory evaluation. A logic model can also help maintain focus and accountability, reveal assumptions, guide and focus work, and supportcontinuous improvement.
Evaluation modelsabstract western michigan university. Introduction results framework the results framework is your ntdp roadmap. At the end of the process, a specific programme logic model and associated implementation plan should be written for every public health programme. Kirkpatricks fourlevel training evaluation model can help you to answer questions like these.
Logic models and program evaluation edward monaghan, ome preeti choudhary, ome. We then focus on several commonly used program evaluation models in the context of those theoretical bases. A logic model shows a series of linkages thatare expected to accomplish the program goals. However, the most commonly used is the context, input, process, output cipp evaluation models. Outcomeeffectiveness evaluation measures program effects in the target. It helps identify what is necessary to achieve desired outcomes in a planning mode and serves to. All human service programs are designed to make a difference in the lives of people or to. Use program theory and logic models, but be flexible, and open to. Taba 1962 and varis 1996 particularly emphasize the interaction between the components of a curriculum. Methodology a threepart search was undertaken to explore how these issues had been ad.
Evaluation models 11 program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation were classified on. The major question guiding this kind of evaluation is, is the program. Educational program evaluation using cipp model neliti. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model, and. You can use it to objectively analyze the impact of training, to work out how well your team members learned, and to improve their learning in the future. Program evaluation some myths about program evaluation. Using programme theory to evaluate complicated and complex. If you have the pills, then you can take the pills, if you take the pills, then headache will go away. This approach often generated extensive data from which very carefully. The evaluation results may contribute to the modification or formation of the curriculum for example, results of formative evaluation may help in 1. This paper reveals a new evaluation model, which enables educational program and project managers to evaluate their programs with a. How to evaluate the programme world health organization.
The task is complicated by the many specific evaluation issues that may require attention, by the numerous methods that could be used to gather and examine information given the resources and time available, and by the need to ensure that all relevant issues are examined. On the two extremes, their design models, process, methods, and types of information may indeed differ. The evaluation context is used to give a rational reason a selected program or curriculum to be. Project programme monitoring and evaluation guide 2. Evaluation of training and development is the most essential aspect of training programme. Logic models for program design, implementation, and evaluation. For many years evaluation experts focused on simply measuring program outcomes patton, 2011. The mission of the office of migrant education is to provide excellent leadership, technical assistance, and financial support to improve the educational opportunities and academic success.
Figure 4 model of the effect of an excise tax 101 table 1 basic program evaluation issues 4 table 2 considerations in developing credible evaluations 22 table 3 example of descriptive statistics 84 table 4 further descriptive data 87 table 5 example of descriptive statistics 89. Chapter 12 curriculum evaluation sage publications. This was a problem with evaluations in the past when program evaluation methods were chosen largely on the basis of achieving complete scientific accuracy, reliability and. Logic models reveal the relationships among program resources, activities, outputs, and short, mid, and longterm outcomes. At different points in your program cycle, you may need to use different types of evaluation designs.
Generally all good training and development programmes start with identification of training and development needs and ends with evaluation of training gopal, 2009. Evaluation models and approaches the monograph uses the term evaluation approach rather than evaluation model because the former is broad enough to cover illicit as well as laudatory practices. This article provides a quick overview of 4 evaluation models youll find most useful. What is evaluation use the program theory or logic model to come up with evaluation questions does the program have a positive outcome. An evaluation framework for community health programs. Choose a program evaluation model that allows you to. Any attempt to obtain information feedback on the effects of training programme. Evaluation planning ll 73737373 using your logic model to plan for evaluation t hinking through program evaluation questions in terms of the logic model components you have developed can provide the framework for your evaluation plan. The aim is to determine the relevanc e and fulfillment of objectives, development efficiency. In this article, well explore kirkpatricks model and how to apply it. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. Years of experience helped us develop our program implementation model. Qualitative research methods in program evaluation.
Evaluation models values in studying alternative program evaluation approaches are to discover their strengths and weaknesses, decide. Modification of programme elements summative evaluation at its conclusion. Program theory and logic models 1 wilder research, august 2009 wilder research. Logic models for program design, implementation, and.
We recognize this as a simple systems model the connection of interdependent parts that together make up the whole\it is a\. Evaluation models have not always supported such a range of needs. There are several types of evaluations that can be. The evaluation of simple interventions is intended to either develop or test the recipe that others can then follow. Theories that inform educational program evaluation models 4. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model. Typically, program evaluations are used to measure progress in achieving obje prove program implementation, provide accountability information to stakeholders. Understanding different types of program evaluation program evaluations are conducted for a variety of reasons. Using these types of evaluation can help your program deliver better results and have a greater impact, all while reducing costs.
Is the program working the way it was intended to work. Effective program evaluation is a carefully planned and systematic approach to. Curriculum evaluation is shaped with the questions of an evaluation specialist, and the philosophy taken as a basis has an immediate effect on the evaluation doll. In 1980 when tom first began teaching a graduate level class in program evaluation, he asked the students to give him their perspective on why there is so much resistance to program evaluation of human service. It links the intervention programme activities to programme goals and objectives. Program theory and logic models evaluation resources from wilder research. Evaluation models 11 program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation.
There are many types of logic model which can be used in planning programmes and implementing activities. Types of evaluation centers for disease control and. The cipp model is a social systems model applied to program evaluation. Although methodological diversity in evaluation is widely accepted, and even recommended by. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models. Programme evaluation and strategic reporting a logic model presents programme information and progress towards goals in ways that inform programme stakeholders and advocate for a particular programme approach. Logic model a planning and evaluation tool page 6 of 11 larger, more complex programs can utilize a nested model to better manage program details. Curriculum evaluation should be cyclic, but not linear.