The University of Houston-Clear Lake
EDLS 7130, Program Evaluation

Catalog Description

Prerequisite: EDLS 7033. 3 Semester Credit Hours.

Addresses the evaluation of the effectiveness of programs and policies. Topics include purposes for evaluating; evaluator's role; evaluation structure, various design applications, including experimental, quasi-experimental, and descriptive; indicators for effectiveness and program process; along with a series of components, including collection of quantitative and qualitative data, analysis, and use of evaluation results in the decision-making process.

I. Purpose of the Course

This course has two purposes: To prepare students to plan and conduct effective program evaluations in a setting appropriate to their fields and to evaluate the efficacy of program evaluations planned and conducted by others.

II. Objectives of the Course

The successful student will:

1. Understand the role and purpose of program evaluations.
2. Understand the various program evaluation methods that may be employed and know when it is appropriate to employ each of those methods.
3. Be able to develop program evaluation plans and proposals.
4. Be able to evaluate program evaluation plans, proposals, and evaluation results.
   

III. Text and Additional Reading Resources

Required Text
Fitzpatrick, J., Sanders, J., & Worthen, B. (2004). Program Evaluation: Alternative Approaches and Practical Guidelines, (3rd Ed.), Boston: Allyn & Bacon.

Optional Text
Isaac, S. & Michael, W. (1995). Handbook in Research and Evaluation, (3rd Ed.), San Diego: Educational and Industrial Testing Services.

Key Websites
http://www.wmich.edu/evalctr/ -- The Evaluation Website at Western Michigan University has on-line access to the Journal of MultiDisciplinary Evaluation and other program evaluation information.

http://www.wmich.edu/evalctr/jc/ -- A detailed description of program evaluation standards.

http://www.ojp.usdoj.gov/BJA/evaluation/guide/index.htm -- A site that has information useful for social service program evaluations.

http://www.ojp.usdoj.gov/BJA/evaluation/links/index.htm#university -- A comprehensive list of hyperlinks for program evaluation from the above website.

http://www.nwrel.org/mentoring/evaluation.html -- An excellent list of program review websites from the National Mentoring Center.

IV. Prerequisite Skills for the Course

Students must have completed EDLS 7031, Educational Research I and EDLS 7033, Qualitative Research

V. Course Expectations

Conduct of the Course

The general instruction methodology for this course is an adaptation of the adult education techniques described by Malcolm Knowles in The Modern Practice of Adult Education: Andragogy Versus Pedagogy (1970). Typically each class period will begin with a discussion of the major ideas associated with the topic(s) identified in the course schedule. Afterwards, students will meet in small groups for most class periods throughout the semester (see "Assignments" below) to discuss cases and develop group work products. The cases to be used will be provided by the students. Each student will be required to provide a complete program evaluation plan or a program report an actual evaluation that occurred in the field. The discussions surrounding these real examples will provide the students with the opportunity to learn the concepts and processes related to program evaluation by immediately applying theoretical information to a real situation while building on previously acquired knowledge.

Four of the class sessions will be conducted on-line using the Internet. For each of these sessions, students will be provided with a set of questions to answer that will require them to apply the material provided via the web, as well as additional material researched using the web. The responses to the questions will be discussed using an electronic chat room by each group to arrive at a group response. These will be available for all students for review and comment.

Each group will select a "program" to evaluate and will develop a comprehensive plan that will meet the purpose(s) of the evaluation during the semester. Individual components of this plan are due at various times during the conduct of the course.

Near the end of the course, student groups will orally present their program evaluation plan to the class and will be evaluated on their platform presence, clarity of presentation, and effective use of technology. More information about this evaluation can be found below.

Students will also be required to comment on their achievement of the course objectives in a self-reflection and will prepare a critique of a program evaluation planned or completed evaluation actually conducted in the field. These will provide evidence of individual student learning.

Assignments (Description):

There are six graded assignments for this course. Four of the assignments will be prepared in small groups to which students will be assigned during the first class after the census day. These four assignments will comprise separate elements of a complete program evaluation plan that could be conducted in an EC-12, higher education, or social service setting.

Assignment one - a description of the organization/agency in which the program evaluation will occur and the purpose(s) of the evaluation.

Assignment two - a description of the evaluation methodologies to be used and a comprehensive analysis of the factors that led to the selection of these methodologies. Each evaluation plan will use at least three methodological approaches.

Assignment three - a description of the activities necessary to conduct the evaluation, including timelines and costs associated with the evaluation.

Assignment four - a description of how the evaluation results will be presented, including pro forma tables of summary data and a pro forma executive summary.

The final two assignments will be prepared individually be each student.

Assignment five - a detailed self-reflection about what the student learned, how that knowledge can be used in the student's career, and what the student still needs to master to be able to implement program evaluations in his or her professional setting.

Assignment six - a detailed critique of a program evaluation that has been planned or completed in the field.

All assignments for this must be electronically submitted to the instructor.

Class Attendance and Participation:

Because of the nature of the instructional methodology used in this course, students are highly encouraged to attend each class as significant group work is planned for most class sessions. Students who miss three or more of the class sessions may be dropped from the course.

Student Accommodations Under the Americans with Disabilities Act:

The instructor will endeavor to accommodate any student who requires assistance because of a disability. However if a student requires special accommodation beyond what the instructor can provide, the student should consult the Coordinator of Health Disabilities Services, Bayou 1402, or call (281) 283 - 2627.

Academic Honesty Policy:

Read the Academic Honesty Policy: Honesty Code section of the current UHCL Catalog, or at http://prtl.uhcl.edu/portal/page?_pageid=284,335689&_dad=portal&_schema=PORTALP. The instructor will ruthlessly apply its provisions. Violations may result in several sanctions, including, but not limited to, a student receiving no grade for an assignment, being asked to do another assignment, or failing the course.

VI. Grading Criteria (Assignments and % of points)

Grade Calculation: The student's final grade will be calculated as follows:

Each of the assignments described above will provide the student with an opportunity to earn points toward the final grade. Three additional graded activities will also earn points for the student. Five points will be deducted from each assignment for each day the assignment is late.

A peer evaluation of student participation in all group work will be conducted near the end of the course. This evaluation will be focused on the degree of participation in group meetings and the overall contribution toward the final program evaluation plan (Assignments 1 through 4).

Each group's oral presentation will be evaluated by the other students in the class. This evaluation will assess the clarity of the presentation, the platform skills of the presenters, and the degree to which technology is used to assist the presentation.

Finally, the instructor will assess each group's oral presentation using similar criteria.

The points available for each of the grade-earning activities and assignments are listed in the table below.

Criterion	Maximum Points
Assignment 1, Plan Component	10
Assignment 2, Plan Component	15
Assignment 3, Plan Component	15
Assignment 4, Plan Component	15
Assignment 5, Self-reflection	10
Assignment 6, Program Evaluation Critique	20
Peer Evaluation	5
Oral Presentation, Peers	5
Oral Presentation, Instructor	5
Total	100

Grading Scale:
93 - 100 A    90 - 92 A     87 - 89 B +
83 - 86 B      80 - 82 B     77 - 79 C +
73 - 76 C      70 - 72 C     67 - 69 D +
63 - 66 D      60 - 62 D     < 60 F

VII. Week-to-Week Schedule

This schedule should only be considered an initial plan and is subject to change at any time. While the instructor will attempt to adhere to this schedule, appropriate adjustments may be made due to inclement weather, student progress, and other unplanned events or circumstances. Such changes will be announced in class and posted on the class website as soon as the change becomes necessary. Students are responsible to stay informed.

Date Topic(s) Reading Assignment