Evaluation Use and Decision-Making in Society

Evaluation Use and Decision-Making in Society
Author: Christina A. Christie
Publisher: IAP
Total Pages: 192
Release: 2015-06-01
Genre: Education
ISBN: 1681230062

This volume addresses a fundamental and highly debated issue in the evaluation field – the use of evaluation information for decision-making. Chapter authors honor the contributions of Professor Marvin C. Alkin to the evaluation use literature and advance our thinking on the topic by exploring a wide range of issues related to the theoretical and practical challenges of using evaluation information to make informed, evidence-based decisions. Readers will come away from this volume with a new and clearer understanding of the theoretical, contextual, methodological, and political dimensions of use and with direction for practice. Chapters are written by leading evaluation scholars, including Ernest House; Stewart Donaldson and Tarek Azzam; Eric Barela; Richard D. Nunneley, Jr., Jean A. King, Kelli Johnson, and Laura Pejsa; Eleanor Chelimsky; Michael Quinn Patton; and Wanda D. Casillas, Rodney K. Hopson and Ricardo L. Gomez. Evaluation Use and Decision-Making in Society: A Tribute to Marvin C. Alkin will be of great interest to evaluation students, scholars and practitioners. This volume has scholarly application for those who desire a state-of-the-art resource for the latest insights and perspectives on one of the most pressing issues that the evaluation field faces today, while also serving as a useful guide for both novice and experienced evaluation practitioners. It is appropriate for use in a variety of evaluation courses including Introduction to Evaluation and Procedural Issues in Evaluation as well as topical seminars such as Evaluation Use and Decision-Making.

Utilization-Focused Evaluation

Utilization-Focused Evaluation
Author: Michael Quinn Patton
Publisher: SAGE Publications, Incorporated
Total Pages: 376
Release: 1986
Genre: Political Science
ISBN:

The second edition of Patton's classic text retains the practical advice, based on empirical observation and evaluation theory, of the original. It shows how to conduct an evaluation, from beginning to end, in a way that will be useful -- and actually used. Patton believes that evaluation epitomizes the challenges of producing and using information in the information age. His latest book includes new stories, new examples, new research findings, and more of Patton's evaluation humour. He adds to the original book's insights and analyses of the changes in evaluation during the past decade, including: the emergence of evaluation as a field of professional practice; articulation of standards for evaluation; a methodological synthesis of the qualitative versus quantitative debate; the tremendous growth of 'in-house' evaluations; and the cross-cultural development of evaluation as a profession. This edition also incorporates the considerable research done on utilization during the last ten years. Patton integrates diverse findings into a coherent framework which includes: articulation of utilization-focused evaluation premises; examination of the stakeholder assumption; and clarification of the meaning of utilization. --Publisher description.

Growing the Knowledge Base in Evaluation

Growing the Knowledge Base in Evaluation
Author: Jill Anne Chouinard
Publisher: IAP
Total Pages: 216
Release: 2019-09-01
Genre: Education
ISBN: 1641137711

Evaluation use was identified by Henry and Mark (2003) as being the single most studied area in the field of evaluation. They refer with a sense of nostalgia to the ‘golden age’ of research on use perhaps almost implying that it came and went. Professor J. Bradley Cousins has had a longstanding and continuing commitment to advancing theory and practice regarding use through empirical research on evaluation, and through the professional development of students and practitioners within North America and internationally. The important influence and impact of the contributions of Cousins and associates is the focus of this edited book. This book brings together a distinguished, international group of authors, to reflect on the areas of contribution of Professor Cousins, and situate his work within contemporary areas of evaluation research and practice. Each chapter describes how the study and practice of evaluation has weaved its way through our understanding of organizational learning, participatory evaluation, and evaluation capacity building. The book concludes with a reflection by Professor Cousins himself on what these insights mean for the field of evaluation, and what future areas of research and contribution can be planned for and anticipated.

Higher Education: Handbook of Theory and Research

Higher Education: Handbook of Theory and Research
Author: Laura W. Perna
Publisher: Springer
Total Pages: 0
Release: 2020-04-26
Genre: Education
ISBN: 9783030313647

Published annually since 1985, the Handbook series provides a compendium of thorough and integrative literature reviews on a diverse array of topics of interest to the higher education scholarly and policy communities. Each annual volume contains chapters that discuss salient dimensions of scholarly and policy inquiries on topics pertaining to college students and faculty, organization and administration, curriculum and instruction, policy, diversity issues, economics and finance, history and philosophy, community colleges, advances in research methodology and more. Each chapter provides a comprehensive review of research findings on a selected topic, critiques the research literature in terms of its conceptual and methodological rigor and sets forth an agenda for future research intended to advance knowledge on the chosen topic. The series is fortunate to have attracted annual contributions from distinguished scholars throughout the world.

System Evaluation Theory

System Evaluation Theory
Author: Ralph Renger
Publisher: IAP
Total Pages: 218
Release: 2022-09-01
Genre: Business & Economics
ISBN:

Too often evaluation findings end up on the shelf! Why? Many interventions have several moving parts working together to achieve something each part cannot do independently. Unfortunately, many of the available evaluation approaches oversimplify this reality. A major reason for this is that evaluators do not have a blueprint to plan, and the associated methods to execute, an evaluation fit for this purpose. As such, they revert to using methods with which they are familiar, but are not suitable, for evaluating complex interventions. Consequently, the evaluation findings do not make sense to decisionmakers, so they are ignored. This book provides evaluators of all skill levels with a simple 3-step framework, System Evaluation Theory, that will lead to more actionable recommendations because the methods better capture the reality in which interventions operate; that is as a system. The book first reviews the limitations of program evaluation approaches that pointed to a need for a different way of thinking, one grounded in systems. After defining a system, the book explains how SET is intentionally aligned to evaluate a system’s two essential properties: interdependence and emergence. Individual chapters are dedicated to explaining how to execute each SET step. Throughout, the author draws on real-world examples and those from his own evaluations to help bridge the theory-practice divide. The reader is then shown how to use SET to develop actionable recommendations.

Practical Wisdom for an Ethical Evaluation Practice

Practical Wisdom for an Ethical Evaluation Practice
Author: Marthe Hurteau
Publisher: IAP
Total Pages: 214
Release: 2023-01-01
Genre: Business & Economics
ISBN:

This book provides a contemporary and thought-provoking exploration of the concept of practical wisdom--what it is and how it can be incorporated into evaluation practice. It defines what practical wisdom is, explores its roots, where it stands today, what constitutes the "wise" evaluator, and how we can develop sound judgment in an unpredictable and chaotic time. It brings together evaluation thought leaders and practitioners to examine the concept of practical wisdom. The authors’ enlightening essays are interwoven with reflective strands comprised of commentaries, examples, and new ideas added by Hurteau and her colleagues that offer a recursive and intricate pattern of reflection on the topic of practical wisdom. This is a rare book because it moves beyond evaluation methodology to explore how practical wisdom can help us develop new and better solutions for difficult evaluation situations. It will become a standard reference for practitioners, trainers. and teachers of evaluation because it considers the history, ethics, and competencies that underpin practical wisdom, and examines the ways that this untaught skill can be applied, to do, as House says, “the right thing in the special circumstances of performing the job.”

Utilization-Focused Evaluation

Utilization-Focused Evaluation
Author: Michael Quinn Patton
Publisher: SAGE Publications
Total Pages: 398
Release: 2021-10-11
Genre: Social Science
ISBN: 1544379471

The Fifth Edition of the bestselling Utilization-Focused Evaluation provides expert, detailed advice on conducting evaluations that promote effective use of the findings. Chock full of useful pedagogy, this book presents Michael Quinn Patton′s distinctive opinions based on more than forty years of experience, and also the expertise of new co-author Charmagne E. Campbell-Patton. The authors begin by describing the essence of utilization-focused evaluation, and then outline 10 operating principles. They conclude with chapters focused on how evaluation can be used to promote a more thoughtful, equitable, and sustainable world. Richly illustrated with examples, figures, and cartoons, this engaging text shows readers how to design and conduct evaluations that provide useful findings, and which contribute to a more equitable society. A companion website is available to accompany this book.

Democratic Evaluation and Democracy

Democratic Evaluation and Democracy
Author: Donna Podems
Publisher: IAP
Total Pages: 257
Release: 2017-02-01
Genre: Education
ISBN: 1681237903

Democratic evaluation brings a way of thinking about evaluation’s role in society and in particular, its role in strengthening social justice. Yet the reality of applying it, and what happens when it is applied particularly outside the West, is unclear. Set in South Africa, a newly formed democracy in Southern Africa, the book affords an in-depth journey that immerses a reader into the realities of evaluation and its relation to democracy. The book starts with the broader introductory chapters that set the scene for more detailed ones which bring thorough insights into national government, local government, and civil societies’ experience of evaluation, democratic evaluation and their understanding of how it contributes to strengthening democracy (or not). A teaching case, the book concludes by providing guiding questions that encourage reflection, discussion and learning that ultimately aims to inform practice and theory.

Enhancing Evaluation Use

Enhancing Evaluation Use
Author: Marlène Läubli Loud
Publisher: SAGE Publications
Total Pages: 289
Release: 2013-04-05
Genre: Social Science
ISBN: 1483321061

Enhancing Evaluation Use: Insights from Internal Evaluation Units offers invaluable insights from real evaluators who share strategies they have adopted through their own experiences in evaluation. Readers will learn about the challenges, solutions, and lessons drawn from the experience of evaluators working in a wide range of organizations. Referencing the latest literature, contributors discuss factors that help or undermine attempts to foster an evaluative thinking and learning culture within an organization. Applicable in a wide range of situations, their accounts demonstrate the initiative and innovative thinking they use to address challenges in various, sometimes complex, evaluation settings. Questions at the end of each chapter stimulate thought and discussions about the issues raised and allow readers to apply their findings to their own situations. "This book speaks to a cutting-edge topic, that is, the potential to generalize program evaluation expertise to larger organizational questions, and the cases from multiple international contexts represent a unique feature." —John Clayton Thomas, Georgia State University "The use of actual cases to highlight major concepts in evaluation in the public sector is a great feature." —Danica G. Hays, Old Dominion University "The text provides practical information from a variety of organizational contexts and the integration of international experiences provides for expanded discussion of evaluation theory and practice." —Kathleen Norris, Plymouth State University "The key strengths of this book lie in its national, supra-national and international organizational contexts, its consistency in insider perspectives, and the detailed examples provided." —Donna Haig Friedman, University of Massachusetts, Boston "The book of essays reviewed here was edited by two eminent evaluators. It fills an important gap in the literature: in pursuit of improved quality of evaluation products, evaluation thinkers have lavished attention on evaluation methods, ethics and use but they have sorely neglected evaluation governance issues and have largely failed to probe the workings of evaluation within organizations. Yet, most evaluations are commissioned by (or undertaken within) organizations. The choices organizations make in structuring evaluation functions and designing evaluation processes have a major bearing on the relevance, validity and usefulness of evaluations. Refreshingly, the book offers fresh mental models and practical lessons about evaluation systems and practices adopted in diverse organizational settings. All contributors to the book are seasoned practitioners. They hail from national, supranational and international organizations and many of them have trespassed across these thematic and organizational boundaries. They all are equipped to draw on a vast reservoir of hands---on experience as evaluation commissioners, managers, internal evaluators or external practitioners. Remarkably, they also display considerable familiarity with relevant themes treated by the organization management and evaluation literature. Given its pragmatic focus the book is bound to elicit broad based interest among evaluation practitioners. While it addresses familiar dilemmas and challenges (evaluation independence, evaluation utilization, organizational learning, nurturing of an evaluation culture, etc.) it does so from the distinctive perspective of "insiders" who have had to contend with a variety of organizational constraints and management pressures. Revealingly most contributors find good reasons to be optimistic about the possibility of positive change. The stage is set by John Mayne whose introductory and authoritative chapter identifies the critical importance of organizational factors in the utilization of evaluation results. This is followed by Bastiaan de Laat’s chapter which puts forward an ingenious analytical construct: the "tricky triangle" of relationships that links commissioners, evaluators and evaluands. Specifically De Laat unmasks and assesses the different and complex configurations that result from this triangular interplay. Penny Hawkins’ elegant contribution underlines the importance of evaluation independence. It highlights the considerable impact that the electoral cycle may have on evaluation approaches. It also reveals that indigenous cultures may present formidable obstacles to the very notion of external evaluative oversight. The next chapter penned by Marlene Laubli’s is equally perceptive in tracing the creative adaptation that the evaluation function underwent in response to changes in the organizational force field of the Swiss Federal Office of Public Health’s Evaluation Unit. In a similar vein Erica Wimbush provides a lucid exposition of the strategies used to bridge evaluative knowledge and management action in Scotland’s public health agency. Still within the health field, Nancy Porteous and Steve Montague show convincingly that transformative organizational change in Canada’s Public Health Agency was facilitated through judicious evaluation programming and what has come to be called "double loop learning". Finally, Bastiaan de Laat and Kevin Williams summarize important findings from of two empirical studies of evaluation use in the European Commission that go a long way in identifying good practices for evaluation commissioning in a supra--- national organizational context. The next two chapters of the book focus on two specialized agencies of the United Nations. They tread gently in what is admittedly a highly sensitive and contested terrain. Maria J. Santamaria Hergueta, Alan Schnur and Deepak Thapa discuss how the World Health Organization’s evaluation function evolved towards greater independence over several decades while Janet Neubecker, Matthew Ripley and Craig Russon focus on the innovative techniques used within the International Labour Organization to enhance utilization of self evaluation findings. The final chapter by Marlene Laubli Loud misses the opportunity to compensate for the "good news" bias that understandably characterizes the previous contributions. Surprisingly, it displays ambivalence towards evaluation independence which it equates with externality, a concept soundly rejected by de Laat. But setting this dimension aside, the chapter is interesting and valuable since it reflects the co---editor’ vast experience as an evaluator, evaluation trainer and evaluation manager in diverse national and international contexts. Thus the chapter provides a useful compilation of "take away" messages focused on good evaluation management practices. It is on solid grounds when it describes how to make effective use of advisory committees, motivate potential evaluation users, design good terms of reference, select the right evaluators, craft judicious evaluation policies and keep an eye out for political "windows of opportunity". Each chapter of the book concludes with a crisp exposition of overarching findings, discussion topics and references. Thus the volume should be of practical value to teachers, students, professional evaluators as well as evaluation commissioners and programme managers. All in all, this is a book that belongs on your shelf if you are intent on enhancing the role that evaluation plays in your organization." —Robert Picciotto, UKES Council Member