CISC 634
Curriculum Appraisal

TOPIC B

Objectives-oriented evaluation

Distinguishing feature: purposes of some activity are specified and evaluation focuses on extent to which purposes are achieved

Objectives-oriented evaluation Examples

Tylerís steps

Tylerís purposes vs. Educational Variables

Two Points

Logical Methods

Empirical Methods

Metfessel and Michael Steps

Metfessel & Michael

Provusís Discrepancy Model

Provus: Developmental stages of a program

Provus Discrepancy Model

Hammondís Cube

Bloom and Krathwohl

Cronbach

Scrivenís Goal-Free Evaluation

Major characteristics of
goal-free evaluation

Strengths

Weaknesses

Other Weaknesses

Management-oriented evaluation

Stufflebeamís CIPP

Input: Structuring decisions (what resources are available; what alternative strategies should be considered; what plan has the best potential

 

Context Evaluation

 

Input evaluation

 

Looks at resources, time, budgets, potential barriers, and consequences of not overcoming barriers, relevance of design to objectives

Methods for input evaluation often lacking in education. May include committee deliberations, review of professional literature, consultants, experimental projects

 

Formality of input evaluation depends on whether change is large or small and whether high or low information grasp is available to support change

Process evaluation

Decision: for implementing and refining program design and procedures, process control, information to use in interpreting outcomes

 

Four essential features: full-time evaluator, instruments for describing process, regular feedback, frequent updating of process evaluation design

Product evaluation

 

Stufflebeamís evaluation steps

Alkinís Model (UCLA)

 

Program improvement: how a program is functioning, whether objectives are being achieved, whether unanticipated outcomes are appearing (process)

Other management-oriented approaches

Formative vs. Summative
CIPP

Strengths

 

Weaknesses

 

Example


Outcome Measurement

Benefits reported by users

What is an Outcome

Inputs -> Outputs

Lessons Learned: Value of Outcome Measurement

Lessons Learned: Effective implementation

 

One Approach

Lessons Learned: Useful Roles for Funders

Lessons: Resource Allocation

Lessons Learned: Limitations

Many things outcomes measurement does not do - monitor resources/outputs, measures the "right" outcomes, explain particular levels of outcomes, "prove", answer judgment questions

Measuring and improving program-level outcomes does not by itself improve broader level outcomes, there are many other influences.

Challenges in Outcomes Measurement