9-stage Evaluation Process

Basic
1 / 108
0
0
1301 days ago, 548 views
PowerPoint PPT Presentation

Presentation Transcript

Slide 1

Essential Program Evaluation NTSC Training Materials

Slide 2

Purpose/Objectives Increase your insight into procedures required in program assessment Provide data and assets to help you outline and lead your own program assessment

Slide 3

Program Evaluation Training This preparation introduction is in 16 modules, incorporating 9 stages in the assessment procedure

Slide 4

Program Evaluation Training – Modules Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 5

Program Evaluation Training – Modules Module 7 – Data Collection Plan Module 8 – How to Collect Data Module 9 – Using Commercial Instruments Module 10 – Using Self-Constructed Instruments Module 11 – Collecting Data

Slide 6

Program Evaluation Training – Modules Module 12 – Analyzing Data Module 13 – Drawing Conclusions and Documenting Findings Module 14 – Disseminating Information Module 15 – Feedback for Program Improvement Module 16 – Conclusion

Slide 7

Program Evaluation Training – Modules Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 8

Module 1 – Introduction Module 1 – Introduction Why assess? What is assessment? What does assessment do? Sorts of assessment

Slide 9

Why Evaluate? Decide program results Identify program qualities Identify and enhance shortcomings Justify utilization of assets Increased accentuation on responsibility Professional obligation to show viability of program

Slide 10

What is Program Evaluation? Intentional , methodical , and watchful gathering and investigation of data utilized with the end goal of recording the viability and effect of projects, setting up responsibility, and distinguishing zones requiring change and change

Slide 11

What Evaluation Does Looks at the consequences of your venture of time, mastery, and vitality, and contrasts those outcomes and what you said you needed to accomplish

Slide 12

Kinds of Evaluation Outcome Implementation Formative Summative

Slide 13

Outcome Evaluation What : Identifies the outcomes or impacts of a program When : You need to gauge understudies' or customers' learning, states of mind, and practices subsequently of a program Examples : Did program build accomplishment, decrease truancy, make better basic leadership?

Slide 14

Implementation Evaluation What : Documents what the program is and to what degree it has been actualized When : another program is being presented; recognizes and characterizes the program; distinguishes what you are really assessing Examples : Who gets program, where is program working; is it being executed a similar route at each site?

Slide 15

Timing of Evaluation Formative as the program is going on to roll out improvements as program is being actualized Summative toward the finish of a program to archive comes about

Slide 16

Module 2 – Overview Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 17

Overview – The 9-stage Process Planning Development Implementation Feedback

Slide 18

Overview – The 9-stage Process

Slide 19

Overview – The 9-stage Process

Slide 20

Overview – The 9-stage Process

Slide 21

Module 3 – Defining the Purpose Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 22

9-stage Evaluation Process Step 1: Define Purpose and Scope

Slide 23

Step 1: Scope/Purpose of Evaluation Why are you doing the assessment? compulsory? program results? program change? What is the degree? How vast will the exertion be? expansive/little; wide/limit How complex is the proposed assessment? numerous factors, many inquiries? What would you be able to sensibly fulfill?

Slide 24

Resource Considerations Resources $$ Staff who can help? need to get ability? do it without anyone's help? admonitory group? Time Set needs How you will utilize the data

Slide 25

Module 4 – Specifying the Questions Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 26

9-stage Evaluation Process Step 2: Specify Evaluation Questions

Slide 27

Evaluation Questions What is it that you need to think about your program? operationalize it (make it quantifiable) Do not advance in the event that you can't answer this question.

Slide 28

Sources of Questions Strategic arrangements Mission proclamations Policies Needs evaluation Goals and targets National measures and rules

Slide 29

Broad Questions Broad Scope Do our understudies contribute decidedly to society after graduation? Do understudies in our new coaching program have a more positive self-idea and preferable basic leadership aptitudes over understudies without access to the tutoring program? What exactly degree does the state's profession improvement program add to understudy preparation for further instruction and preparing and achievement in the workforce?

Slide 30

Narrow Questions Narrow Scope Can our sixth grade understudies recognize suitable and unseemly social practices? What number of our tenth grade understudies have distinguished their business related interests utilizing an intrigue stock? Have 100% of our tenth grade understudies distinguished no less than 3 occupations to investigate additionally in view of their interests, capacities, and information of instruction and preparing necessities?

Slide 31

Exercise 1 – Scope (p. 2 of Workbook) From the rundown of inquiries, recognize those that may be viewed as wide and those that may be viewed as restricted How expansive will the assets should be to answer the question

Slide 32

Exercise 2 – Scope Write (p. 3 of Workbook) List one wide assessment question and one tight assessment address

Slide 33

Module 5 – Identifying Evidence Needed Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 34

Identifying Evidence Needed to Answer Your Questions What confirm do you need to answer your question?

Slide 35

Identifying Evidence Needed to Answer Your Questions Need to consider what data you require so as to answer your assessment questions

Slide 36

Example Evidence – Broad Scope Do our understudies contribute emphatically to society after graduation? Percent of our understudies that are utilized, in instruction or preparing programs, in the military, are supporting a family by working at home, as well as are volunteering for magnanimous causes 3 years after secondary school graduation Percent of our understudies that vote in neighborhood and national decisions 5 years after graduation

Slide 37

Example Evidence – Narrow Scope Have 100% of our tenth grade understudies distinguished no less than 3 occupations to additionally investigate that depend on their interests, capacities, and information of the instruction and preparing prerequisites? Number of eleventh and twelfth grade understudies partaking in the profession class that exhibited expanded vocation development from a pre-and post-test

Slide 38

Exercise 3 – Evidence (p. 4 of Workbook) List prove you need to answer the question

Slide 39

Module 6 – Specifying the Design Module 1 – Introduction Module 2 – Overview Module 3 – Defining the Purpose Module 4 – Specifying the Questions Module 5 – Identifying Evidence Needed Module 6 – Specifying the Design

Slide 40

9-stage Evaluation Process Step 3: Specify Evaluation Design

Slide 41

Types of Designs Relates to when information ought to be gathered Status (without a moment's hesitation; preview) Comparison (amass A versus bunch B; program A versus program B) Change (what occurred thus of a program; what contrasts are there between time An and time B) Longitudinal (what occurs over broadened time)

Slide 42

Exercise 4 – Design (p. 5 of Workbook) What sort of configuration fits every assessment address? Status Comparison Change Longitudinal

Slide 43

Module 7 – Data Collection Plan Module 7 – Data Collection Plan Module 8 – How to Collect Data Module 9 – Using Commercial Instruments Module 10 – Using Self-Constructed Instruments Module 11 – Collecting Data

Slide 44

9-stage Evaluation Process Step 4: Create a Data Collection Action Plan

Slide 45

Evaluation Question 1 What is Collected How Collected/What Technique From Whom/Data Sources When Collected and By Whom How Data are to be Analyzed Organize Your Evaluation With a Data Collection Action Plan

Slide 46

Components of a Data Collection Action Plan What Will be Collected? in light of confirmation required How Collected? Instrumentation studies? distributed instrument? center gathering? perceptions?

Slide 47

Components of a Data Collection Action Plan From Whom Collected? who or what gives prove When Collected and by Whom? particular dates, times, people How Data are to be Analyzed?

Slide 48

Data Sources — Who and What Students Parents Teachers Counselors Employers Friends Documents and other

SPONSORS