Program Evaluation Plan

Template Instructions

Different sections of this course project template will be completed as weekly assignments. Follow the instructions in the courseroom for each assignment and the instructions in italics below for each section. Delete the instructions (in italics), including these, before you submit the final draft of the Program Evaluation Plan in Week 9. Do not delete the headings.

Introduction

Provide a one-paragraph introduction for the paper, stating the plan’s purpose (to present an evaluation plan), the program for which the evaluation was planned, and how the paper’s content is organized.

Part 1: Site and Program Description

Program Evaluation Site Information

The purpose of this section is to introduce your site in no more than one to two paragraphs. Provide a short description of the organization. Depending on the type of organization, key information for the organizational introduction should include items such as name and location of the organization and its size (number of employees, student enrollment, revenues, and so on), mission, and organizational structure (departments, divisions, and so forth).

Description of the Program

Name and provide a short description of the program that will be the focus of the evaluation study. Be concise, but include all major program components. Be sure to include how long the program has been in operation and whether any major changes have taken place over time.

 

Purpose of the Program

Explain the role (function or purpose) of the program and its importance to the organization. Support this narrative with data and evidence.

Stakeholders and Participants

Name the stakeholder groups who will benefit from or will be impacted by the program evaluation. These groups have a stake in the evaluation. Describe the key stakeholders’ roles and why/how they would be impacted by a program evaluation.

Identify those people you believe should be participants in the evaluation (such as people from whom you would plan to collect feedback, input, or data, or with whom you would collaborate to complete the evaluation).

Program Goals/Objectives

Identify the original goals and/or objectives of the program. Note whether a problem has been identified with the program, such as low student achievement or low employee performance.

(In some cases, the program evaluator will find that the objectives of the program were insufficiently defined. The program evaluation depends on the use of the original program objectives to determine if the program has met its objectives. When objectives are missing, the program evaluator should review documents to determine if the objectives can be derived from the documents. The program evaluator might also speak with the program developers and program administrators to determine how they have been guiding the program.)

Your Role in (or Connection With) the Program

Describe your role in the organization. (If not employed by the organization, explain the nature of your relationship with the organization.) Briefly discuss how your role in or relationship with the organization and the proposed program evaluation are connected. For example, if you are a principal, are you accountable for an after-school or mentoring program at your school?

Need for the Evaluation

Explain the need for the proposed program evaluation and why it is important. What will be the impact or benefit of the evaluation?

Collaboration

Program evaluation is a process that involves stakeholder participation and collaboration. Identify stakeholders with whom you plan to hold informal conversations to learn more about this program for your evaluation plan.

Then, imagine you will actually conduct an evaluation of the program in the future. Briefly describe how you would collaborate with different stakeholders and stakeholder groups in the organization to identify and discuss the need for a program evaluation of this program. How would you characterize the level of support you believe an evaluation study would receive at the organization?

Permissions

NOTE: You may need permission to access archived or records data at your site to complete the course assignments. If so, who will provide the permission?

Part 2: Evaluability Assessment and Logic Model

First, complete the Evaluability Assessment in the Appendix of this document. Then, introduce it and provide the summary here. Based on the program’s status as in the Appendix, provide an assessment of program information, data, and documentation in terms of their availability and accessibility. For example, a program description may exist, but data about the program’s implementation may be undocumented or anecdotal. Determine information, data, and/or documentation about the program that would need to be collected to conduct or strengthen a program evaluation. Note any aspects of the program such as long-term outcomes that are not currently evaluable at all.

Next, develop a transition to the logic model, complete the Logic Model Development table below, and provide a detailed description of the model.

Logic Model Development

RESOURCESACTIVITIESOUTPUTSSHORT- & LONG-TERM OUTCOMESIMPACT
To accomplish our set of activities, we will need the following:To address our problem or asset we will accomplish the following activities:We expect that, once accomplished, these activities will produce the following evidence or service delivery:We expect that if accomplished these activities will lead to the following changes in 1–3 then 4–6 years:We expect that, if accomplished, these activities will lead to the following changes in 7–10 years:
     

Source:W. K. Kellogg Foundation. (2004). Logic model development guide. https://bttop.org/sites/default/files/public/W.K.%20Kellogg%20LogicModel.pdf

Part 3: Evaluation Questions

Complete the Evaluation Planning Template below. Then, provide an explanation of the chart, with any updates or revisions you have made as a result of feedback and/or further information you have acquired about the program. Refer to the Assessing Impact text and other resources for information about developing questions. Check alignments with your evaluation type/purpose (formative or summative), your audience, your questions, and information use. (See page 38 of the Kellogg Foundation’s Logic Model Development Guide.)

For the purposes of this practice exercise, provide focus area, audience, questions, and uses for formative and summative purposes and address context, implementation, and outcomes (see figure on page 36).

Be sure to discuss whether your program evaluation purpose is formative, process-oriented, or summative, or possibly serves formative and summative needs. Explain your decision. Further, discuss how you would prioritize your questions (and/or the scope of your evaluation). Justify your response.

Evaluation Planning Template

Evaluation Focus AreaAudienceEvaluation QuestionUse
    
  
   
  
   
  
   
  
    
  
   
  
   
  
   
  

Source:W. K. Kellogg Foundation. (2004). Logic model development guide. https://bttop.org/sites/default/files/public/W.K.%20Kellogg%20LogicModel.pdf

Part 4: Data Collection Plan

Complete the Indicators Development Template below, with any updates or revisions you have made as a result of feedback and/or further information you have acquired about the program. Below, include your analysis of the table’s elements.

Indicators Development Template

Focus AreaQuestionIndicators (Types of Data)Technical Assistance Needed (Sources of Data)
    
   
   
    
   
   

Source:W. K. Kellogg Foundation. (2004). Logic model development guide. https://bttop.org/sites/default/files/public/W.K.%20Kellogg%20LogicModel.pdf

Ethics and Risks

Analyze legal and ethical issues that impact how data is collected as part of the program evaluation plan and describe what you would do to mitigate these risks. These include participant risk, potential coercion, conflicts of interest, confidentiality issues, and biases. What are possible ethical or regulatory considerations for the program evaluation that has been designed? Provide a reasoned assessment of these potential risks and ethical issues. Cite your sources.

Part 5: Organizational Context

Provide a brief (one to two paragraphs) analysis of the site’s organizational context. This section is an account of the forces (such as political, economic, social, cultural, and ethical systems) that may influence, amplify, or moderate the program’s effectiveness, success, or impact.

Part 6: Detailed Design Steps

Provide a step-by-step plan for how you will conduct the program evaluation. List the tasks in chronological order and estimate the duration of each. Include who will be involved in the tasks you describe (program administrators, program implementers, and so on), where they will be performed (at meetings, the organization for on-site activities, online), and so on. Estimate a specific period of time for the entire program evaluation (such as 2 months or 3 months).

Evaluation TaskWhoWhereDuration (weeks/months)
    
    
    
    
    
    
    
    

Part 7: Review of the Literature

Insert your 5–7 page review of the literature in this section. Start it on a new page. Follow the instructions for the literature review in the Prepare: Literature Review study in Week 2. Your reference list goes below, under the References heading.

Part 8: Conclusion

Begin your conclusion on a new page.

Provide a conclusion to your program evaluation plan that explains the scope and significance of your proposed program evaluation. Reiterate the benefits of the evaluation and, citing sources, integrate systems concepts into a brief analysis of the role of evaluation in learning organizations.

This statement may include the number of people who will be positively affected by an evaluation; its systems implications; its impact to the organization or department(s) as a whole; any linkage to organizational goals and objectives or mission and values; its duration; the implications beyond the institution/organization; and/or the strength of leadership commitment to the implementation of the evaluation study. The program evaluation plan should have implications for change and impact at the organizational level.

References

APPENDIX. EVALUABILITY ASSESSMENT

(Adapted from the United Nations Office on Drugs and Crime, www.unodc.org)

Does the quality of the program design allow for the evaluation?

 Not at all truePartially trueTrueNot applicable
The purpose of the program is realistic.    
The program objectives are clear, realistic, and commonly understood by the stakeholders.    
There are key performance indicators (KPIs) that are specific, measurable, attainable, relevant, and time-bound (SMART), as well as goal-based indicators that can help keep employees on track.    
Performance indicators are monitored adequately.    
There is a logical and clear linkage among the program’s purpose/objectives, documentation, implementation, management, monitoring, and evaluation.    
NOTES/COMMENTS  

Are the results of the program verifiable based on the planned collection systems?

Available DataNot at all truePartially trueTrueNot applicable
Baseline data are available to track changes.    
Program documents are available for review.    
Progress reports are documented and available for review.    
Previous reviews were conducted and available.    
Independent project evaluation reports are available.    
Minutes of meetings were recorded and available.    
Studies/research have been conducted on the program.    
Presentations have been shared on the program.    
Agreement(s)/MOU are in effect (such as external contractors).    
Financial documents (budget revisions) are available for review.    
Monitoring data are collected on a regular basis against performance indicators.    
Please name any other available and relevant program documents could be reviewed as part of an evaluation.   NOTES/COMMENTS  

Would the evaluation be feasible, credible, and useful?

Feasible, Credible, and Useful Evaluation  Not at all truePartially trueTrueNot applicable
1. The timing of the evaluation fits into the program cycle (usefulness of evaluation at that time).    
2. The building blocks (components) of the program, if any, been previously evaluated.    
3. The organizational political situation is conducive to the evaluation. (Organizational support would be present.)    
4. The organizational culture is conducive to the evaluation    
6. Key stakeholders in the field are available (if the program includes stakeholders external to the organization or department).    
7. Key stakeholders at higher administrative levels (leaders) are available/supportive.    
8. Budget is sufficient for the evaluation.    
NOTES/COMMENTS    
Based on the above, how would you answer the following:YesNoExplanatory Notes
1. The quality of the program design allows for the evaluation.   
2. The results of the program are verifiable based on the information available/planned collection systems.   
3. The current stage of project execution allows evaluation (it is not too early in the program).   
4. The evaluation would be feasible, credible, and useful.   

Summary

(The summary is to be included in the Program Evaluation Plan document in Part 2: Evaluability Assessment and Logic Model.)

Based on the program’s status as described above, provide an assessment of program information, data, and documentation in terms of their availability and accessibility. For example, a program description may exist, but data about the program’s implementation may undocumented or anecdotal.

Determine information, data, and/or documentation about the program that would need to be collected to conduct or strengthen a program evaluation. Note any aspects of the program such as long-term outcomes that are not currently evaluable at all.

Do you need help with this assignment or any other? We got you! Place your order and leave the rest to our experts.

Quality Guaranteed

Any Deadline

No Plagiarism