Improvement Science in Evaluation: Methods and Uses

Improvement Science in Evaluation: Methods and Uses
Author: Christina A. Christie
Publisher: John Wiley & Sons
Total Pages: 112
Release: 2017-04-24
Genre: Political Science
ISBN: 1119378664

While improvement science has experienced a surge of interest over the past 30 years, applications of it are rare in the evaluation literature. This issue promotes the cross-fertilization of ideas, techniques, and tools between evaluation and improvement science. There are at least four areas where this cross-fertilization is particularly relevant: learning from error, examining variation, appreciating context, and focusing on systems change. This volume considers: the conceptual similarities and distinctions between improvement science and evaluation; the intellectual foundations, methods, and tools that collectively comprise improvement science; and case chapters that offer an inspiring review of state-of-the-art improvement science applications. Cutting across all of these applications is a shared grounding in systems thinking, a determination to capture and better understand variation and contextual complexity, as well as a sustained commitment to generative learning about projects and programs—all issues of great concern to evaluators. The issue offers producers and users of evaluations the potential benefits of a closer engagement with improvement science. This is the 153rd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication ofthe American Evaluation Association.

Leading Change Through Evaluation

Leading Change Through Evaluation
Author: Kristen L. Rohanna
Publisher: SAGE Publications
Total Pages: 177
Release: 2021-09-08
Genre: Education
ISBN: 1071847899

This book shows why those hoping to use evaluation to drive change in complex systems, rather than develop or improve one program, policy, or product, need to shift from the oversimplified idea of formative evaluation to a more specified continuous improvement model grounded in improvement science. In doing so, author Kristen L. Rohanna provides guidance to both evaluators and others, such as K-12 educators or hospital administrators, who lead improvement initiatives in their organizations and seek to solve persistent problems of practice.

Practical Mapping for Applied Research and Program Evaluation

Practical Mapping for Applied Research and Program Evaluation
Author: Bernadette Wright
Publisher: SAGE Publications
Total Pages: 329
Release: 2019-05-31
Genre: Social Science
ISBN: 1544323352

Practical Mapping for Applied Research and Program Evaluation is the first book to bring the mapping methodology to social research and program evaluation. Bernadette Wright and Steven E. Wallis guide readers through all phases of the research process: learning from stakeholder experience; reviewing existing knowledge in the field; conducting new data collection such as interviews; collaborating with other researchers; and facilitating the use of knowledge for communication, collaboration, and action. With plenty of illustrations and navigational aids such as “travel tips,” the book is an accessible guide for busy students, researchers, and managers of all levels of experience.

Improvement Science as a Tool for School Enhancement: Solutions for Better Educational Outcomes

Improvement Science as a Tool for School Enhancement: Solutions for Better Educational Outcomes
Author: Susan P. Carlile
Publisher: Improvement Science in Educati
Total Pages: 125
Release: 2022-02-28
Genre: Education
ISBN: 9781975504793

Improvement Science as a Tool for School Enhancement: Solutions for Better Educational Outcomes is a collection of equity-focused improvement science-in-action, school-based case studies led by practitioners. Chapter authors tell us how and why improvement science principles make system-wide improvements in classroom practice, how they learned from the problems encountered and, further, how they were then able to make changes within a school or district. A core principle of improvement science is variability in context (what works for whom and under what conditions)--a critical concept for improvement in each of the case studies. Each team analyzed their problem of practice from the perspective of the unique conditions in their context, considering what might work, and what might not work, and when the changes could be expanded for implementation school- or district-wide. Early chapters describe the actions of school personnel to embed social and emotional learning as well as how to serve historically underserved students during disasters. Trauma-informed and restorative practices embraced by all staff enhanced student outcomes and reduced educational disparities in classrooms and throughout the school. The content then explores how improvement science change processes improve chronic absenteeism and discipline issues through whole-school practices related to school climate. Centering student and family perception, developing representative systems, and facilitating collaborative improvement projects were found to measurably improve the experience of students, increase equity, reinforce democratic principles, and empower school stakeholders, especially those whose voices have historically been ignored, to create meaningful system-wide school improvement. Finally, the material in the book provides concrete examples of improvement science as it applies in real-setting to address high school advisories, graduation rates, services for multi-lingual learners, students with disabilities, and reading clubs. Each chapter has an equity focus. The editors and contributors provide examples of how to use the processes and tools of improvement science to increase equity system-wide. How to use improvement science to address educational disparities system-wide with urgency, commitment, and a belief in the success of every child, of every race, every ethnicity, gender, ability, and cultural identity, is the essence of this book.

The Improvement Guide

The Improvement Guide
Author: Gerald J. Langley
Publisher: John Wiley & Sons
Total Pages: 514
Release: 2009-06-03
Genre: Business & Economics
ISBN: 0470549033

This new edition of this bestselling guide offers an integrated approach to process improvement that delivers quick and substantial results in quality and productivity in diverse settings. The authors explore their Model for Improvement that worked with international improvement efforts at multinational companies as well as in different industries such as healthcare and public agencies. This edition includes new information that shows how to accelerate improvement by spreading changes across multiple sites. The book presents a practical tool kit of ideas, examples, and applications.

Evaluating and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics

Evaluating and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics
Author: National Research Council
Publisher: National Academies Press
Total Pages: 233
Release: 2003-01-19
Genre: Education
ISBN: 0309072778

Economic, academic, and social forces are causing undergraduate schools to start a fresh examination of teaching effectiveness. Administrators face the complex task of developing equitable, predictable ways to evaluate, encourage, and reward good teaching in science, math, engineering, and technology. Evaluating, and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics offers a vision for systematic evaluation of teaching practices and academic programs, with recommendations to the various stakeholders in higher education about how to achieve change. What is good undergraduate teaching? This book discusses how to evaluate undergraduate teaching of science, mathematics, engineering, and technology and what characterizes effective teaching in these fields. Why has it been difficult for colleges and universities to address the question of teaching effectiveness? The committee explores the implications of differences between the research and teaching cultures-and how practices in rewarding researchers could be transferred to the teaching enterprise. How should administrators approach the evaluation of individual faculty members? And how should evaluation results be used? The committee discusses methodologies, offers practical guidelines, and points out pitfalls. Evaluating, and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics provides a blueprint for institutions ready to build effective evaluation programs for teaching in science fields.

Mixed Methods Design in Evaluation

Mixed Methods Design in Evaluation
Author: Donna M. Mertens
Publisher: SAGE Publications
Total Pages: 201
Release: 2017-07-13
Genre: Social Science
ISBN: 1506330673

In Mixed Methods Design in Evaluation, the first volume of SAGE's Evaluation in Practice Series, best-selling author Donna M. Mertens explores the meaning of mixed methods evaluation, its evolution over the last few decades, and the dominant philosophical frameworks that are influencing thought and practice in the field today. Four chapters explore evaluation of the effectiveness of interventions, development of instruments, systematic reviews, and policy evaluations, while an additional chapter covers evaluation approaches often required in specific contexts including gender responsive evaluations, needs assessment, and evaluations in conflict zones. Practical in nature, the book guides readers’ thinking about the design of mixed methods evaluations through the use of illustrative examples and explanations for further applications.

Leading Change Through Evaluation

Leading Change Through Evaluation
Author: Kristen L. Rohanna
Publisher: SAGE Publications
Total Pages: 140
Release: 2021-10-04
Genre: Social Science
ISBN: 1071847872

Evaluators who are interested in developing or improving a program or policy frequently look to formative evaluation as a guiding framework. This book shows why those hoping to use evaluation to drive change in complex systems, rather than develop or improve one program, policy, or product, need to shift from the oversimplified idea of formative evaluation to a more specified continuous improvement model grounded in improvement science. In doing so, author Kristen L. Rohanna provides guidance to both evaluators and others, such as K-12 educators or hospital administrators, who lead improvement initiatives in their organizations and seek to solve persistent problems of practice. The book includes an extended case study: a networked improvement community of five public middle and high schools.

Improving Quality of Care in Low- and Middle-Income Countries

Improving Quality of Care in Low- and Middle-Income Countries
Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
Total Pages: 111
Release: 2015-11-19
Genre: Medical
ISBN: 030937345X

Quality of care is a priority for U.S. Agency for International Development (USAID). The agency's missions abroad and their host country partners work in quality improvement, but a lack of evidence about the best ways to facilitate such improvements has constrained their informed selection of interventions. Six different methods - accreditation, COPE, improvement collaborative, standards-based management and recognitions (SBM-R), supervision, and clinical in-service training - currently make up the majority of this investment for USAID missions. As their already substantial investment in quality grows, there is demand for more scientific evidence on how to reliably improve quality of care in poor countries. USAID missions, and many other organizations spending on quality improvement, would welcome more information about how different strategies work to improve quality, when and where certain tools are most effective, and the best ways to measure success and shortcomings. To gain a better understanding of the evidence supporting different quality improvement tools and clarity on how they would help advance the global quality improvement agenda, the Institute of Medicine convened a 2-day workshop in January 2015. The workshop's goal was to illuminate these different methods, discussing their pros and cons. This workshop summary is a description of the presentations and discussions.

Enhancing Evaluation Use

Enhancing Evaluation Use
Author: Marlène Läubli Loud
Publisher: SAGE
Total Pages: 289
Release: 2013-04-17
Genre: Business & Economics
ISBN: 1452205477

This book is valuable to those involved in the evaluation of public organisations. Particularly insightful is the realization that similar challenges faced in various organizations are addressed with very different solutions.