Utilizationfocused evaluation by michael quinn patton. These are not exercises for which one can go back and find the answer in the book, but rather applications that require a person to reflect and think. Download it once and read it on your kindle device, pc, phones or tablets. Curran and colleagues 2012 suggest that evaluation of the interventions effectiveness will require or involve use of quantitative measures while evaluation of the implementation process will require or involve use of mixed methods. Evaluation is a process that critically examines a program.
A strong program evaluation process supports accountability while allowing educators to gain useful knowledge about their program and sustain ongoing program development goldie, 2006. Chock full of useful pedagogyincluding a unique utilizationfocused evaluation checklistthis book presents michael quinn patton s distinctive opinions based on more than thirty years of experience. Indeed, pawson has described policies as theories incarnate. Evidence of process use is represented by the following kind of statement after an evaluation. Evaluation models have not always supported such a range of needs. Mertens and wilson 2012 revised and expanded the evaluation theory tree framework beyond use, method, and valuing oriented theories, showing the importance of a separate. Secondary audiences have limited direct involvement with running the project but are still interested in the evaluation report because the results may affect them in some way. How to use qualitative methods in evaluation michael quinn. Patton started a ref lective practice process with the. The second was qualitative and was designed to assess search evaluations and doc. Triangulation in qualitative inquiry involves gathering and. What is evaluation back to determining the evaluation question. Sph 504 health promotion planning and evaluation mccaffrey.
After a brief overview of the project activities and evaluation methods, the report describes the. He has been an independent evaluation practitioner for over 35 years and has worked at local, state, national, and international levels. The fourth edition of the bestselling utilizationfocused evaluation provides expert, detailed advice on conducting program evaluations from one of leading experts. When conducting a hybrid type 1 design conducting a process evaluation of implementation in the context of a. This brief describes practical steps for designing and using theories of change and strategic learning debriefs as tools for creating the space and structure for strategic learning. Its purpose is to make judgments about a program, to improve its effectiveness, andor to inform programming decisions patton, 1987. Useit final evaluation report 2012 bowling green state. Utilization focused evaluation makes this a priority patton, 2012, pp.
The discussion shares lessons learned, and notes the relationship between methods used in system and program evaluation. Utilizationfocused evaluation ufe, developed by michael quinn patton, is an. He has been teaching at the evaluators institute since its beginning. Newer evaluation models support learning about the dynamic processes within the programs. Michael quinn patton, phd, directs an organizational development and evaluation consulting business, utilizationfocused evaluation. He is the founder and director of utilizationfocused evaluation.
Evaluations, and those who request them, may often benefit, though, from a consideration of these other questions. Oct 26, 2012 maria mcduffie rated it it was amazing. An evaluation can help a program improve their services, but can also help ensure that the program is delivering the right services. Sph 504 health promotion planning and evaluation mccaffrey f2015. The preface describes the basics of what developmental evaluation is, how it has evolved, and its niche as evaluating innovations in complex dynamic environments. The impact on our program came not so much from the findings but from going through the thinking process that. Therefore evaluations should be planned and conducted in ways that enhance the likely utilization of both the findings and of the process itself to inform. A theory of change explains how to produce desired outcomes. Pdf utilizationfocused evaluation checklist researchgate. Browse michael quinn patton resources innovation network. Michael quinn patton ces, 2009 some evaluation premises.
Pattons utilization focused evaluation ufe is probably the most. Utilization focused evaluation a primer for evaluators. Purposeful sampling for qualitative data collection and. Qualitative research methods in sure start local programme evaluations. The completely revised and updated edition of this methodological classic continues to provide practical, comprehensive and strategic guidance on qualitative design, purposeful sampling, interviewing, fieldwork, observation methods, and qualitative analysis and interpretation while integrating the extensive qualitative literature of the last decade. Formative evaluation is evaluation designed, done, and in tended to support the process of improvement, and normally commissioned or done by, and delivered to, someone who can make improvements. In the encyclopedia of evaluation, torres 2005 describes three distinct audiences for evaluations. June 2012 this report describes the activities and findings of the useit uniting science education, inquiry, and technology iii project that ran from september 2011 to april 2012. This description helps to identify how the program should lead to the. Chock full of useful pedagogyincluding a unique utilizationfocused evaluation checklistthis book presents michael quinn pattons distinctive opinions based on more than thirty years of experience. Evaluation involves the systematic collection of information about the activities, characteristics and outcomes of programs, personnel, and productsto reduce uncertainties, improve effectiveness and make decisions with regard to what those programs, personnel, or products are doing and affecting. Michael quinn patton born 1945 is an independent organizational development and program evaluation consultant, and former president of the american evaluation association. The book includes the following ten sections and makes use of case examples and stories, cartoons, sidebars, and summary tables. Designing qualitative studies 169 purposeful sampling perhaps nothing better captures the difference between quantitative and qualitative methods.
Be prepared to explain the variations, strengths, and weaknesses of qualitative evaluations. The cse program evaluation kit is a series of nine books intended to assist people conducting program evaluations. An evaluation of the diploma in adult and continuing education programme offered at great zimbabwe university david pesanai chipatiso lecturer, department of adult and continuing education, great zimbabwe university. An evaluation of the diploma in adult and continuing. The results of any particular effort cannot be guaranteed. The checklist is based on essentials of utilizationfocused evaluation patton, 2012, sage publications. Displaying sph 504 health promotion planning and evaluation mccaffrey f2015. Thus, the evaluators sought a framework that could describe any relationship. Michael patton, the father of developmental evaluation, describes this approach to evaluation as grounded in systems thinking, and supportive of innovation by collecting and analyzing real time data in ways that lad to informed and ongoing decision making as part of the design, development and implementation process. Although the evaluation client and the primary intended user may be different, they are often one and the same, and for this reason we use the terms client and primary intended user interchangeably. Jun 01, 2009 michael quinn patton ces, 2009 some evaluation premises.
How to use qualitative methods in evaluation michael. Details displaying sph 504 health promotion planning and evaluation mccaffrey f2015. For many years evaluation experts focused on simply measuring program outcomes patton 2011. In this book, michael quinn patton describes the process of conducting developmental evaluations for ongoing program development. The paper describes how each of these elements informs the evaluation of step two of setevaluating system efficiency. This audience would also be considered the primary intended users of the evaluation patton, 2012. Here, evaluation questions are raised about the resources that will be used to develop and con. Developmental evaluation developmental evaluation was introduced by patton 2008 in his discussion of the concepts of utilizationfocused evaluation, which was first presented in the late 1980s and further developed in a rebuttal patton, 1996 to scrivens published description of the. Apr 01, 1978 the fourth edition of the bestselling utilizationfocused evaluation provides expert, detailed advice on conducting program evaluations from one of leading experts. Utilizationfocused evaluation ufe, developed by michael quinn patton, is an approach based on the principle that an evaluation should be judged on its usefulness to its intended users. Wilson 2012 revised and expanded the evaluation theory tree framework beyond use, method.
Brazil has its own brazilian evaluation network and in october of this year the latin american evaluation association will be launched in peru. As such, it assumes that stakeholders will have a high degree of involvement in many, if. Defining systems to evaluate system efficiency and. Qualitative research and evaluation methods for those in music education trying to present all approaches to research as reasonable and viable options, patton provides a biasfree presentation of appropriate terminology. Designing qualitative studies 169 purposeful sampling perhaps nothing better captures the difference between quantitative and qualitative methods than the different logics that undergird sampling approaches. This audience includes program participants and staff in the organization. This volume, the fourth in the kit, explains the basic assumptions underlying qualitative procedures, suggests evaluation situations where qualitative designs are useful, and provides guidelines for designing qualitative evaluations, including how to use observational methods. The checklist is based on essentials of utilization focused evaluation patton, 2012, sage. Each evaluation being a blend of unique ingredients, no standardized recipe can assure the outcome.
Determine the extent to which qualitative methods are appropriate given the evaluations purposes and intended uses. Defining systems to evaluate system efficiency and effectiveness. The evaluation of educational innovations in the 1950s. According to patton 1997, utilizationfocused program evaluation is evaluation done for and with specific, intended primary users for specific, intended uses p. After receiving his doctorate in sociology from the university of wisconsinmadison, he spent 18 years. The new material and innovative graphics present the utilizationfocused evaluation process as a complex adaptive system. For many years evaluation experts focused on simply measuring program outcomes patton, 2011. The preface describes the basics of what developmental evaluation is, how it. One way to do this is for the evaluator and program people to develop a very good description of. The purpose of this chapter is to describe several of the most influential and useful evaluation models. In pattons latest book, essentials of utilizationfocused evaluation. Evaluators canshould offer conceptual and methodological options. The end of the book chapter 9 includes a lengthy discussion of qualitative. Describes steps and procedures for the planning, implementation, and evaluation of public health programs, policies and interventions.
All references in the checklist to exhibits and menus refer to this book. Evaluation is part of initial program design, including conceptualizing the theory of change evaluators role is to help users clarify their purpose, hopedfor results, and change model. Creates and integrates program goals, objectives, and evaluation criteria for a public health initiative. Integrating theory and practice kindle edition by quinn, patton michael. Step 1 assess and build program and organizational readiness for utilizationfocused evaluation. Evaluation is part of initial program design, including conceptualizing the theory of change evaluator s role is to help users clarify their purpose, hopedfor results, and change model.
Mertens and wilson 2012 revised and expanded the evaluation theory tree framework beyond use, method. In traditional evaluation, patton describes the evaluator as controlling the. Utilizationfocused evaluation begins with the premise that evaluations should be judged by their utility and actual use. It evaluation report 2 june 2012 this report describes the activities and findings of the useit uniting science education, inquiry, and technology iii project that ran from september 2011 to april 2012. Stufflebeams ipp evaluation model defining evaluation. The book offers practical exercises at the end of each chapter. State of the art and practice of developmental evaluation. It involves collecting and analyzing information about a programs activities, characteristics, and outcomes. F utilization focused evaluation a primer for evaluators. Qualitative research and evaluation methods request pdf.
Many timehonored evaluation models remain available for that limited but important purpose. Readers interested in that use are referred to the ufe curriculum. The impact on our program came not so much from the findings but from going through the thinking process that the evaluation required. Michael quinn patton is an independent evaluation consultant with. Michael quinn patton, utilizationfocused evaluation, 740 mississippi river. I havent yet succumbed to the michael quinn patton. When matched to an appropriate complex situation and circumstance, the developmental evaluator in effect becomes part of. A read is counted each time someone views a publication summary such as the title, abstract, and list of authors, clicks on a figure, or views or downloads the fulltext.
Hemmer2 1office of educational development, university of texas medical branch, 301 university boulevard, galveston, texas 775550408, usa, 2department of medicine, uniformed services, university of the health sciences, f. Pattons utilization focused evaluation ufe is probably the most wellknown theory of use though not without its critics3. Michael quinn patton, phd tei the evaluators institute. Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author mi. Applying complexity concepts to enhance innovation and use.
1081 1128 1029 433 1384 447 1509 1117 598 412 1249 1 535 1149 1054 678 727 647 1469 579 44 920 1278 859 1115 999 422 531 1145 1250 1459 1294 1440 726 806 913