CISC 634
Curriculum Appraisal


Objectives-oriented evaluation

Distinguishing feature: purposes of some activity are specified and evaluation focuses on extent to which purposes are achieved

Objectives-oriented evaluation Examples

Tylerís steps

Tylerís purposes vs. Educational Variables

Two Points

Logical Methods

Empirical Methods

Metfessel and Michael Steps

Metfessel & Michael

Provusís Discrepancy Model

Provus: Developmental stages of a program

Provus Discrepancy Model

Hammondís Cube

Bloom and Krathwohl


Scrivenís Goal-Free Evaluation

Major characteristics of
goal-free evaluation



Other Weaknesses

Management-oriented evaluation

Stufflebeamís CIPP

Input: Structuring decisions (what resources are available; what alternative strategies should be considered; what plan has the best potential


Context Evaluation


Input evaluation


Looks at resources, time, budgets, potential barriers, and consequences of not overcoming barriers, relevance of design to objectives

Methods for input evaluation often lacking in education. May include committee deliberations, review of professional literature, consultants, experimental projects


Formality of input evaluation depends on whether change is large or small and whether high or low information grasp is available to support change

Process evaluation

Decision: for implementing and refining program design and procedures, process control, information to use in interpreting outcomes


Four essential features: full-time evaluator, instruments for describing process, regular feedback, frequent updating of process evaluation design

Product evaluation


Stufflebeamís evaluation steps

Alkinís Model (UCLA)


Program improvement: how a program is functioning, whether objectives are being achieved, whether unanticipated outcomes are appearing (process)

Other management-oriented approaches

Formative vs. Summative






Outcome Measurement

Benefits reported by users

What is an Outcome

Inputs -> Outputs

Lessons Learned: Value of Outcome Measurement

Lessons Learned: Effective implementation


One Approach

Lessons Learned: Useful Roles for Funders

Lessons: Resource Allocation

Lessons Learned: Limitations

Many things outcomes measurement does not do - monitor resources/outputs, measures the "right" outcomes, explain particular levels of outcomes, "prove", answer judgment questions

Measuring and improving program-level outcomes does not by itself improve broader level outcomes, there are many other influences.

Challenges in Outcomes Measurement