Program Evaluation Plan

Complete the Site and Program Description section of a program evaluation plan using the provided template. This portion of the Program Evaluation Plan includes site information, a description of the program and its purpose, stakeholders and participants, the program’s goals and objectives, your role within (or in connection with) the program, the need for the evaluation, collaboration details, and any permissions that will be required.
Note: The site and program you choose for this assessment will continue through Assessment 4. You should complete the course assessments in sequential order.

Introduction
Ikujiro Nonaka (1991) characterized knowledge-creating companies as places where “inventing new knowledge is not a specialized activity. . . . It is a way of behaving, indeed a way of being, in which everyone is a knowledge worker” (para. 9). Evaluation is a crucial component of knowledge-creating.

You will use the Program Evaluation Plan Template for each assessment as you build your plan. You will be able to refine your responses in the template as you progress through each segment.
This assessment provides you with an opportunity to reflect on your organization’s characteristics and identify programs at your organization that could serve as the basis of the program evaluation. Learning organizations rely on information and data about their products, programs, and services to engage in continuous improvement. Program evaluation is an opportunity to improve a program during implementation (formative evaluation) or to determine a program’s impact to make decisions about its continuance (summative evaluation).
Reference
Nonaka, I. (1991, November–December). The knowledge-creating company. Harvard Business Review. https://hbr.org/1991/11/the-knowledge-creating-company-2
Overview
You will use the Program Evaluation Plan Template [DOCX] for each assessment as you build your Program Evaluation Plan. You will be able to refine your responses in the template as you progress through the plan.
Begin by reflecting on your organization’s characteristics and identifying programs at your organization that could serve as the basis of the program evaluation. Learning organizations rely on information and data about their products, programs, and services to engage in continuous improvement. Program evaluation is an opportunity to improve a program during implementation (formative evaluation) or to determine a program’s impact to make decisions about its continuance (summative evaluation).

Instructions
Using the Program Evaluation Plan Template [DOCX], complete Part 1: Site and Program Description, which includes the following:
• Program Evaluation Site Information.
• Description of the Program.
• Purpose of the Program.
• Stakeholders and Participants.
• Program Goals/Objectives.
• Your Role in (or Connection With) the Program.
• Need for the Evaluation.
• Collaboration.
• Permissions.
Refer to the instructions in the template for completing each required component of Part 1.
Review the assessment scoring guide to ensure that you meet all requirements. Submit your template with Part 1 completed.
Additional Requirements
In addition to the requirements outlined above, your assessment should meet the following:
• Assessment template: Use the Program Evaluation Plan Template [DOCX] for the assessment.
• APA style and format: Be sure to use current APA style and format throughout your paper, including citations on your reference list. Refer to Evidence and APA for more information.
• ePortfolio: You may choose to save this learning activity to your ePortfolio.
Competencies Measured
By successfully completing this assessment, you will demonstrate your proficiency in the following course competencies and scoring guide criteria:
• Competency 1: Apply evaluation models and theories to improvement planning.
o Describe the program evaluation site.
o Describe the program to be evaluated.
• Competency 2: Apply data methods and research reasoning to evaluation of programs, processes, and innovation.
o Describe the program’s need for evaluation.
• Competency 3: Apply principles of reflective practice and reflection in practice to improvement cycles.
o Describe one’s role/relationship with the evaluation site.
• Competency 4: Apply critical thinking skills and habits of mind to evaluation.
o Convey clear meaning through appropriate word choice and usage.

Part 2

Complete and submit Part 2: Evaluability Assessment and Logic Model and Part 3: Evaluation Questions of the Program Evaluation Plan Template. This portion of the Program Evaluation Plan asks you to complete an evaluability assessment of the program, create a logic model, and develop evaluation questions.

Note: The site and program you choose for this assessment will continue through Assessment 4. You should complete the course assessments in sequential order. You will use the Program Evaluation Plan Template for each assessment as you build your plan. You will be able to refine your responses in the template as you progress through each segment.

Introduction
Assessment 2 builds on the work you did in Part 1 of the Program Evaluation Plan, identifying the organization’s characteristics and programs that could serve as the basis of the program evaluation. Not every program is ready for evaluation. Many factors can impact the evaluability of programs, including the age of the program, how much data has been generated by the program’s outcomes, the expense of the evaluation process, the time and energy of the employees who will conduct the evaluation process, and other issues. As you begin a program evaluation, you must determine whether the program evaluation can return reliable results. Part 2 of the Program Evaluation Plan includes completion of the Evaluability Assessment and the creation of a Logic Model. Part 3 includes the development of evaluation questions that address the purpose of your program evaluation, including your rationale and prioritization of those questions.

Overview
For this assessment, you will complete and submit Part 2 and Part 3 of the Program Evaluation Plan Template.

Instructions
Complete and submit the following parts of the Program Evaluation Plan Template. Continue using the Program Evaluation Plan Template you began in Assessment 1.

Part 2: Evaluability Assessment and Logic Model.
Part 3: Evaluation Questions.
Part 2: Evaluability Assessment and Logic Model
Evaluability Assessment

For this component, consider the evaluability of the program you have chosen to focus on. As we have discussed, Wholey (1979) advocated for the use of evaluability assessments to save costs. Follow the instructions for Part 2 in the Program Evaluation Plan Template to complete the Evaluability Assessment. As you do so, consider the organizational climate and merit of the recommendation that the organization undertake a full program evaluation plan. Ideally, you have chosen a program that is ready for a program evaluation, as you will need to consider what resources, data, and collaboration you would require to conduct a full evaluation. You may choose to have a discussion with your administrator to gather needed information to complete the template; however, you are not required to gather any data or evidence beyond that which is readily available. Your sole outcome in this assessment is to render a recommendation that the program quality is such that it warrants a program evaluation.

Logic Model

You have deepened your understanding of the program you chose for the course project by conducting the Evaluability Assessment (including document review and possible consultation with the program’s sponsor, participants, and/or stakeholders). Based on what you know now, follow the instructions for Part 2 in the Program Evaluation Plan Template to construct a logic model of the program using the Logic Model Development table (from page 54 of the Kellogg Foundation’s Logic Model Development Guide [PDF]), and provide a detailed explanation of the model.

Part 3: Evaluation Questions
Follow the instructions for Part 3 in the Program Evaluation Plan Template to complete the Evaluation Planning Template (from page 59 of the Kellogg Foundation’s Logic Model Development Guide [PDF]). Then, in the Program Evaluation Plan Template, write several paragraphs that address the following:

Whether your program evaluation purpose is formative, process oriented, summative, or possibly serves formative and summative needs.
Explain your decision.
How you would prioritize your questions (and/or the scope of your evaluation).
Justify your response.
Additional Requirements
In addition to the requirements outlined above, your assessment should meet the following:

Assessment template: Use the Program Evaluation Plan Template for the assessment.
APA Style and Format: Be sure to use current APA style and format throughout your paper, including citations on your reference list. Refer to Evidence and APA for more information.
Font: Times New Roman, 12 points.
Reference
Wholey, J. S. (1979). Evaluation: Promise and performance. The Urban Institute.

Competencies Measured
By successfully completing this assessment, you will demonstrate your proficiency in the following course competencies and scoring guide criteria:

Competency 1: Apply evaluation models and theories to improvement planning.
Provide defined objectives, purpose, and timing of the planned program evaluation.
Competency 2: Apply data methods and research reasoning to evaluation of programs, processes, and innovation.
Provide a method that includes review of documentation, access to data and information, stakeholder identification, and data analysis.
Provide an assessment that answers key questions as to realistic possibilities of a program evaluation.
Provide credible evidence of the verifiability of program information and utility of the evaluation.
Provide logical recommendations as to how or if to proceed with the program evaluation.
Explain the relationship between evaluation questions, evaluation focus area, and the intended audience.
Competency 4: Apply critical thinking skills and habits of mind to evaluation.
Adhere to the rules of grammar, usage, and mechanics.

Part 3
Complete Part 4 of the Program Evaluation Plan, which outlines a data collection plan for your program evaluation.
Interpreting data is done differently depending on the design that you select as a researcher. The approach you take involves following certain steps and processes, such as data triangulation or field testing, to ensure the validity, credibility, and transferability of your study or project.
Overview
For this assessment, you will complete Part 4 of the Program Evaluation Plan Template by providing data types (program description, meeting minutes, interviews, and so on) and sources of data to answer the evaluation questions you developed for Part 3 of the template. Consider archived data that may be available as well. Once again, as you study the contents of the exercise, you may find you need to revise your logic model and/or your evaluation questions.
Instructions
Using the Program Evaluation Plan Template you began for Assessment 1 and continued using for Assessment 2, complete Part 4: Data Collection Plan.
In Part 4 of the Program Evaluation Plan Template, complete the Indicators Development Template. Refer to Exercise 5, starting on page 45 of the Kellogg Foundation’s Logic Model Development Guide [PDF] as you complete the table. Also, review the Exercise 5 Checklist on page 47, and ensure that you can check “yes” for each item before finalizing your table.
Below the Indicators Development Template table in the Program Evaluation Plan Template, include several paragraphs that describe and explain the elements in your table.
Once you have determined the data necessary to conduct a program evaluation, consider whether there are ethical issues or risks to people from whom data will be collected (or the program’s participants). The Ethics and Risks section of the Program Evaluation Plan Template follows the Data Collection Plan in Part 4. Use this section to analyze legal and ethical issues that impact how data is collected and analyzed if the data collection were implemented as planned. Refer to your Assessing Impact text and other resources for information about the use of data and information sources in evaluation.
Additional Requirements
• Template: Remember to use the Program Evaluation Plan Template to complete this assessment. Complete the Indicators Development Template table and include several paragraphs that describe and explain the elements in your table. Also complete the Ethics and Risk section. In addition, include the most accurate and updated program evaluation plan components based on feedback and iterative review of your project components
• APA format: Be sure to use current APA style and format throughout your paper, including citations on your reference list. Refer to Evidence and APA for more information.
• Portfolio prompt: You are required to save this learning activity to your ePortfolio.
Competencies Measured
By successfully completing this assessment, you will demonstrate your proficiency in the following course competencies and scoring guide criteria:
• Competency 2: Apply data methods and research reasoning to evaluation of programs, processes, and innovation.
o Analyze legal and ethical issues that impact how data is collected and analyzed in a learning organization.
o Identify indicators (data types) for each evaluation question.
o Describe technical assistance needed (data sources) for each evaluation question.
• Competency 4: Apply critical thinking skills and habits of mind to evaluation.
o Support main points, assertions, arguments, conclusions, or recommendations with relevant and credible evidence.

Part 4
Complete Parts 5 – 8 of the Program Evaluation Plan Template, including the organizational context, a detailed outline of the design steps, a review of the literature, and a final conclusion. The entirety of the Program Evaluation Plan will be submitted as one complete document.
It is important to evaluate measurement instruments. Validity in research is essential as we look to assess whether or not we are measuring what we intend to measure. You will submit your Final Program Evaluation Plan, which will be the culmination of the other evaluation-based assessments you’ve completed in the course.
Overview
In this assessment, you will complete the remaining sections of the Program Evaluation Plan Template. You will also use the feedback from your instructor to revise and polish the sections you completed in previous assessments.
Instructions
Using the feedback from your instructor, revise the following components of the Program Evaluation Plan Template:
• Part 1: Site and Program Description.
• Part 2: Evaluability Assessment and Logic Model.
• Part 3: Evaluation Questions.
• Part 4: Data Collection Plan.
Finish the Program Evaluation Plan Template by completing the following, following the instructions in the template:
• Part 5: Organizational Context.
• Part 6: Detailed Design Steps.
• Part 7: Review of the Literature.
• Part 8: Conclusion.
• References.
• Appendix.
A literature review is a required element of your Final Program Evaluation Plan. You will be expected to incorporate 6–8 new resources (beyond those assigned) related to the theoretical basis, research, and best practices about the program for which you will develop a program evaluation plan. For example, if your program is a mentoring program, provide a review of research about the theoretical bases for such programs and best practices related to the implementation and evaluation of mentoring programs. The literature should include peer-reviewed journal articles, professional literature, and, potentially, seminal works.
The objective of the review of literature is to demonstrate your grasp of the theoretical or conceptual framework used originally in the development of the program, research that has been conducted on your chosen program type, and best practices in development and implementation of your program type. You may include program evaluation resources. For example, if a curricular program uses constructivism as a learning theory, discuss this theory as well as research about the application of the theory. You would also discuss best practices about the implementation of the program, including research about and evaluation of such programs.
Properly paraphrase, integrate, and cite your sources. This is not an annotated bibliography! The review of scholarly sources should provide support for your approach to the evaluation, given the type of evaluation and program that is involved. Use headings as appropriate. Aim for a review of 5–7 pages, not including references. You will not need a cover page because the literature review is part of the program evaluation plan; you will insert the literature review into the Program Evaluation Plan Template. The reference list is a separate heading that will include all references used in the program evaluation plan.
Take a little time now to make some initial literature review preparations:
• If you do not have a RefWorks account, set one up now.
• Develop a tentative plan to search the literature for journal articles and research related to the program you have chosen for your course project. Your plan may be adjusted as you progress through the course.
Refer to the following Campus and library links as you prepare your literature review:
• Evidence and APA.
• University Library.
• Writing Center.
• How Do I Find Peer-Reviewed Articles?
• Reference Page.
• Writing a Literature Review [PDF].
• EdD Program Library Research Guide.
Additional Requirements
• Length: 12–15 pages, plus title and references pages.
• References: Include at least seven scholarly or peer-reviewed references. For research assistance, visit the University Library and the EdD Program Library Research Guide.
• APA format: Follow current APA style and formatting, including a cover page, headings, and a hanging indent for all citation entries. Refer to Evidence and APA and Capella’s Writing Center for more information.