Program Evaluation Webinar Series Part 2:

Program evaluation webinar series part 2 l.jpg
1 / 159
0
0
1098 days ago, 400 views
PowerPoint PPT Presentation

Presentation Transcript

Slide 1

Program Evaluation Webinar Series Part 2: "Beginning and Engaging Your Stakeholders" Presented by: Leslie Fierro and Carlyn Orians

Slide 2

Getting Started and Engaging Your Stakeholders Leslie A. Fierro , MPH TKCIS Contractor NCEH/CDC Let6@cdc.gov Carlyn Orians , MA, Battelle Centers for Public Health Research and Evaluation orians@battelle.org Presented November 20, 2008

Slide 3

Agenda Definition of assessment. Contrast between assessment & investigate. CDC's Evaluation Framework. The who, why, when & how of partners. Unmistakable cases of drawing in partners.

Slide 4

What is the Purpose of Evaluation?

Slide 5

Evaluation: Definition 1 Evaluation is the deliberate examination of the legitimacy, worth, or essentialness of a protest. - Michael Scriven

Slide 6

Evaluation: Definition 2 Evaluation is the orderly appraisal of the operation as well as the results of a program or arrangement, contrasted with an arrangement of unequivocal or verifiable benchmarks as a method for adding to the change of the program or approach. - Carol Weiss

Slide 7

Evaluation: Definition 3 Evaluation is the precise gathering of data about the exercises, qualities, and results of projects to make judgments about the program, enhance program viability, and additionally advise choices about future programming. - Michael Patton

Slide 8

The Common Element Note that each of the 3 of these announcements share a typical component. .. … they all characterize assessment as an orderly and formalized attempt .

Slide 9

Summative Evaluations Summative assessments try to judge a program by asking, "Ought to this venture be… " scratched off? proceeded? extended?

Slide 10

Formative Evaluations Formative assessments look to utilize the assessment discoveries. They pose the question: "Is the program being directed as arranged?" "Is the program doing great?" Formative assessments look to enhance projects or strategies.

Slide 11

The CDC Definition Evaluation is the precise gathering of data about the exercises, qualities and results of the program to make judgments about the program, enhance program viability as well as illuminate choices about future program advancement.

Slide 12

Research versus Assessment Research and assessment share procedures yet ask diverse inquiries. Particular to Research Specific to Evaluation Commonalities

Slide 13

The Research Context

Slide 14

Research Findings Research is led to: test and enhance hypotheses. create generalizable speculations. hypotheses apply crosswise over various settings, individuals, and times.

Slide 15

The Evaluation Context

Slide 16

Evaluation Findings Evaluation results: are not normally generalizable. concentrate on a particular circumstance. assessment of a solitary program in a specific setting.

Slide 17

Research versus Assessment Evaluation asks: "Is this program working?" Research asks: "Will this program work over various settings ?"

Slide 18

The Role of Researchers: Play a solitary part as substance specialists.

Slide 19

The Role of Researchers: Play a solitary part as substance specialists. Distinguish crevices in current information.

Slide 20

The Role of Researchers: Play a solitary part as substance specialists. Distinguish crevices in current learning. Determine their own inquiries.

Slide 21

The Role of Researchers: Play a solitary part as substance specialists. Recognize holes in current learning. Determine their own inquiries. Play out their own exploration.

Slide 22

The Role of Evaluators: Play numerous parts—facilitator, instructor, logical master, and so forth

Slide 23

The Role of Evaluators: Play different parts—facilitator, teacher, logical master, and so on. Include partners.

Slide 24

The Role of Evaluators: Play numerous parts—facilitator, teacher, logical master, and so on. Include partners. Team up to distinguish and organize questions.

Slide 25

"Research looks to demonstrate , assessment tries to enhance . " M.Q. Patton In a Nutshell …

Slide 26

The Findings Must be Useful To enhance a program, the discoveries must be valuable ! How? The partners must be included. The inquiries must be important to the program. The discoveries must be trustworthy to key partners.

Slide 27

Getting Started and Engaging Your Stakeholders The Who, When, Why, and How of Stakeholder Involvement in CDC's Evaluation Framework

Slide 28

"Who" are the Stakeholders? Partners are: individuals as well as associations that are occupied with the program , are keen on the aftereffects of the assessment or potentially have a stake in what will be finished with the consequences of the assessment.

Slide 29

Examples of Stakeholders

Slide 30

Each Program is Different Develop a rundown of partners toward the begin of any assessment action.

Slide 31

Which Stakeholders Matter Most? Survey your rundown of partners and contemplate these inquiries: "Who do we have to … "

Slide 32

Which Stakeholders Matter Most? Audit your rundown of partners and ponder these inquiries: "Who do we have to … " upgrade validity ?

Slide 33

Which Stakeholders Matter Most? Survey your rundown of partners and ponder these inquiries: "Who do we have to … " improve believability? actualize program changes ?

Slide 34

Which Stakeholders Matter Most? Survey your rundown of partners and contemplate these inquiries: "Who do we have to … " improve validity? actualize program changes? advocate for changes ?

Slide 35

Which Stakeholders Matter Most? Audit your rundown of partners and ponder these inquiries: "Who do we have to … " upgrade validity? actualize program changes? advocate for changes? finance , approve, or grow the program ?

Slide 36

"Why" Engage Stakeholders? Connecting with partners is a vital part of the CDC Evaluation Framework. Including partners might be a necessity of your program.

Slide 37

"Why" Engage Stakeholders? Drawing in partners is an imperative part of the CDC Evaluation Framework Stakeholders will include validity. On the off chance that you need the outcomes to be followed up on, they should be dependable.

Slide 38

"Why" Engage Stakeholders? Drawing in partners is an essential part of the CDC Evaluation Framework. Partners will include validity. Partners may have assets to offer assistance. Partners might have the capacity to contribute information, abilities, logical aptitudes, and so on

Slide 39

"Why" Engage Stakeholders? Connecting with partners is an imperative part of the CDC Evaluation Framework. Partners will include validity. Partners may have assets to offer assistance. Partners might be basic to executing or pushing for activity in light of the outcomes.

Slide 40

"Why" Engage Stakeholders? Drawing in partners is a critical part of the CDC Evaluation Framework. Partners will include believability. Partners may have assets to offer assistance. Partners might be basic to actualizing or upholding for activity in light of the outcomes. You will manufacture trust and comprehension among program constituents. Including partners lessens dread of the assessment procedure.

Slide 41

"Why" Would Stakeholders Want to be Involved? Get answers to their inquiries.

Slide 42

"Why" Would Stakeholders Want to be Involved? Get answers to their inquiries. Find out about assessment.

Slide 43

"Why" Would Stakeholders Want to be Involved? Get answers to their inquiries. Find out about assessment. Impact the outline and techniques.

Slide 44

"Why" Would Stakeholders Want to be Involved? Get answers to their inquiries. Find out about assessment. Impact the plan and strategies. Ensure their constituents.

Slide 45

"Why" Would Stakeholders Want to be Involved? Get answers to their inquiries. Find out about assessment. Impact the plan and strategies. Ensure their constituents. Roused to program succeed.

Slide 46

CDC's Evaluation Framework STEPS Engage partners Ensure utilize and share lessons learned Describe the program Standards Utility Feasibility Propriety Accuracy Focus the assessment plan Justify conclusions Gather valid proof

Slide 47

"When" and "How" Can You Engage Stakeholders? You can utilize the CDC Evaluation Framework to connect with partners in: distinguishing and organizing assessment questions, selecting tenable sources, and building up an arrangement for activity in light of assessment results.

Slide 48

"When" and "How" Can You Engage Stakeholders? You can connect with partners in each progression of the assessment procedure. Be that as it may, you don't need to connect with partners in all these courses in each assessment.

Slide 49

"How" Depends on… Evaluator inclination.

Slide 50

"How" Depends on… Evaluator inclination. Partner inclination.

Slide 51

"How" Depends on… Evaluator inclination. Partner inclination. Assets.

Slide 52

"How" Depends on… Evaluator inclination. Partner inclination. Assets. Level of trust or dangers to validity.

Slide 53

"How" Depends on… Evaluator inclination. Partner inclination. Assets. Level of trust or dangers to validity. On the off chance that there is a high level of doubt, draw in partners right on time in the assessment procedure. This guarantees the outcomes are seen as dependable and are followed up on.

Slide 54

CDC's Evaluation Framework STEPS Engage partners Ensure utilize and share lessons learned Describe the program Standards Utility Feasibility Propriety Accuracy Focus the assessment outline Justify conclusions Gather believable proof .:tsl

SPONSORS