Evidence-Based Policy

Evidence-Based Policy
Author: Nancy Cartwright
Publisher: Oxford University Press
Total Pages: 209
Release: 2012-09-20
Genre: Political Science
ISBN: 0199986703

Over the last twenty or so years, it has become standard to require policy makers to base their recommendations on evidence. That is now uncontroversial to the point of triviality--of course, policy should be based on the facts. But are the methods that policy makers rely on to gather and analyze evidence the right ones? In Evidence-Based Policy, Nancy Cartwright, an eminent scholar, and Jeremy Hardie, who has had a long and successful career in both business and the economy, explain that the dominant methods which are in use now--broadly speaking, methods that imitate standard practices in medicine like randomized control trials--do not work. They fail, Cartwright and Hardie contend, because they do not enhance our ability to predict if policies will be effective. The prevailing methods fall short not just because social science, which operates within the domain of real-world politics and deals with people, differs so much from the natural science milieu of the lab. Rather, there are principled reasons why the advice for crafting and implementing policy now on offer will lead to bad results. Current guides in use tend to rank scientific methods according to the degree of trustworthiness of the evidence they produce. That is valuable in certain respects, but such approaches offer little advice about how to think about putting such evidence to use. Evidence-Based Policy focuses on showing policymakers how to effectively use evidence, explaining what types of information are most necessary for making reliable policy, and offers lessons on how to organize that information.

Why Context Matters

Why Context Matters
Author: Thomas Friemel
Publisher: Springer Science & Business Media
Total Pages: 172
Release: 2008-11-06
Genre: Social Science
ISBN: 3531911848

In the last few years there has been a growing interest in using computers not only for quantitative but also for qualitative content analyses of various kinds of texts and unstructured interviews (Fielding and Lee 1993, Kelle 1998, Kuckartz 2001, Miles and Huberman 2005, Lewins and Silver 2007). This trend has given rise to the development of new software products such as MAXqda, NVivo, NUD. IST, and ATLAS. ti, which can be used for automatic coding, text retrieval, hyp- linking of related text segments, etc. Some of these programs such as ATLAS. ti or MAXqda even allow to represent the results of qualitative content analyses in graphical form as semantic networks of coded texts (Sowa 1984: 76 ff. , Lewins and Silver 2007: 179 ff. ). Such networks consist of 1. text segments or so-called quotations, which generally constitute a n- overlapping partition of the analyzed text corpus, 2. codes, which are classificatory attributes of the mentioned text segments, 3. links, which are the result of the content analytic coding and describe the attribute relations between the mentioned codes and quotations. Minestrone Soup Non-Eggs Ticinese Leek soup White wine Vegetables Romandie Figure 1: An example of a semantic network of a coded text: soup recipes from Latin Switzer- 1 land Fig.

Context Matters for Size

Context Matters for Size
Author: Lant Pritchett
Publisher:
Total Pages: 55
Release: 2013
Genre:
ISBN:

In this paper we examine how policymakers and practitioners should interpret the impact evaluation literature when presented with conflicting experimental and non-experimental estimates of the same intervention across varying contexts. We show three things. First, as is well known, non-experimental estimates of a treatment effect comprise a causal treatment effect and a bias term due to endogenous selection into treatment. When non-experimental estimates vary across contexts any claim for external validity of an experimental result must make the assumption that (a) treatment effects are constant across contexts, while (b) selection processes vary across contexts. This assumption is rarely stated or defended in systematic reviews of evidence. Second, as an illustration of these issues, we examine two thoroughly researched literatures in the economics of education -- class size effects and gains from private schooling -- which provide experimental and non-experimental estimates of causal effects from the same context and across multiple contexts.We show that the range of “true” causal effects in these literatures implies OLS estimates from the right context are, at present, a better guide to policy than experimental estimates from a different context. Third, we show that in important cases in economics, parameter heterogeneity is driven by economy- or institution-wide contextual factors, rather than personal characteristics, making it difficult to overcome external validity concerns through estimation of heterogeneous treatment effects within a single localized sample. We conclude with recommendations for research and policy, including the need to evaluate programs in context, and avoid simple analogies to clinical medicine in which “systematic reviews” attempt to identify best-practices by putting most (or all) weight on the most “rigorous” evidence with no allowance for context.

How Does Context Matter? Comparing Achievement Scores, Opportunities to Learn, and Teacher Preparation Across Socio-economic Quintiles Using TIMSS and PISA

How Does Context Matter? Comparing Achievement Scores, Opportunities to Learn, and Teacher Preparation Across Socio-economic Quintiles Using TIMSS and PISA
Author: Frank Marshall Adamson
Publisher: Stanford University
Total Pages: 418
Release: 2010
Genre:
ISBN:

Many people have touted education as a great equalizer because it provides students with the skills and opportunity to succeed in life based on their own merit. While this attitude has helped increase access to education around the world, the quality of that education varies. Globally, education has multiple challenges. On the micro level, educational quality remains inconsistent, and on the macro level, increasing economic inequality has potential to deleteriously affect education. This study analyzes the relationships between micro level education phenomena and these macro level economic forces to determine how economic inequality relates to education quality. This study engages the infamous educational "black box" in three different areas that capture, in aggregate, a meaningful portion of the classroom experience: opportunity to learn (OTL), teacher preparation, and student achievement. The analysis situates educational quality in the context of country-level economics by comparing students across three types of economic disparities: inequality between countries, inequality within countries, and inequality in the socio-economic status (SES) of students. Between-country inequality consists of differences in overall country income while within-country inequality concerns the distribution of income. Between-student inequality gauges the relative SES of families and their ability to provide resources conducive to education. The main hypothesis is that high SES students in more-unequal countries have relatively more access to educational resources, leading to relatively better teachers, relatively more OTL, and higher math scores. The converse would hold true for low SES students. Findings from international comparisons using the international assessments in 2003 (PISA and TIMSS) show that income inequality adversely relates to educational factors for students in all SES groups. Both high and low SES students in more-unequal countries have lower achievement scores, less prepared teachers, and less OTL. More detailed analysis at the country level does not identify any "silver bullets" for low or high income inequality countries, but does show that OTL has a greater relationship to achievement for higher SES students, while environmental factors such as community size matter for low SES students. Theses findings imply that high SES students have the foundation to take better advantage of their educational settings while low SES students must first manage their social and economic environments.

Context Matters

Context Matters
Author: Peter J. Boettke
Publisher: Now Publishers Inc
Total Pages: 89
Release: 2009
Genre: Entrepreneurship
ISBN: 1601982062

Context Matters: Institutions and Entrepreneurship analyzes the connection between entrepreneurship and institutions. The goal is to provide a discussion of the literature on institutions in economics, develop the argument on the relationship between institutions and entrepreneurship and apply this logic to a variety of entrepreneurial settings - private for-profit, private non-profit and political. In addition to exploring entrepreneurship within several institutional settings, the authors also consider entrepreneurship on institutional arrangements. Context Matters: Institutions and Entrepreneurship develops the notion of institutions and provide insight into what this concept entails. The authors show how institutions matter for entrepreneurship and economic development. This if followed by a consideration of 'social entrepreneurship', 'political entrepreneurship', and the role of 'institutional entrepreneurs' and their impact on the formation and evolution of institutions. The authors end with a discussion of the implications for future research.

The Explanation of Crime

The Explanation of Crime
Author: Per-Olof H. Wikström
Publisher: Cambridge University Press
Total Pages: 325
Release: 2006-11-30
Genre: Social Science
ISBN: 1139460218

Integration of disciplines, theories and research orientations has assumed a central role in criminological discourse yet it remains difficult to identify any concrete discoveries or significant breakthroughs for which integration has been responsible. Concentrating on three key concepts: context, mechanisms, and development, this volume aims to advance integrated scientific knowledge on crime causation by bringing together different scholarly approaches. Through an analysis of the roles of behavioural contexts and individual differences in crime causation, The Explanation of Crime seeks to provide a unified and focused approach to the integration of knowledge. Chapter topics range from individual genetics to family environments and from ecological behaviour settings to the macro-level context of communities and social systems. This is a comprehensive treatment of the problem of crime causation that will appeal to graduate students and researchers in criminology and be of great interest to policy-makers and practitioners in crime policy and prevention.

Impact Evaluation in International Development

Impact Evaluation in International Development
Author: Paul Glewwe
Publisher: World Bank Publications
Total Pages: 544
Release: 2022-01-25
Genre: Business & Economics
ISBN: 1464814988

Impact evaluations are studies that attempt to measure the causal impact of a project, program or policy on one or more outcomes of. This book provides a comprehensive exposition of how to conduct impact evaluations. Part I provides an overview of impact evaluations and comprises five chapters which are accessible to readers who have few or none of the technical (statistical and econometric) skills that are needed to conduct impact evaluations. Parts II and III make use of statistical and econometric methods and are at a level similar to a graduate-student course but written to make them accessible to the ambitious reader whose skills are not at that level. Part II presents, in Chapters 6-10, a comprehensive discussion of the use of randomized controlled trials (RCTs) to conduct impact evaluations, including a general discussion of the ethical issues involved in conducting impact evaluations. Part III presents the main non-experimental methods that are used to implement impact evaluations when RCTs are not feasible or not recommended for other reasons. Chapters 11 and 12 present regression methods, including difference-in-differences estimation. Matching methods are described in Chapter 13, after which regression discontinuity methods are covered in Chapter 14. Instrumental variable methods, including the estimation of local average treatment effects (LATE), are discussed in detail in Chapter 15. Chapters 16 and 17 cover more advanced topics: quantile treatment effects and control function methods, respectively. Part IV then considers more practical issues when conducting impact evaluations, including designing questionnaires (Chapter 18), data collection methods and survey management (Chapters 19 and 20), and disseminating results to policymakers (Chapter 21). Finally, Part V addresses two topics in impact evaluation: qualitative methods for conducting impact evaluations (Chapter 22), and cost-benefit and cost-effectiveness analysis (Chapter 23).

Cognitive Development in Digital Contexts

Cognitive Development in Digital Contexts
Author: Fran C. Blumberg
Publisher: Academic Press
Total Pages: 372
Release: 2017-07-05
Genre: Psychology
ISBN: 0128097094

Cognitive Development in Digital Contexts investigates the impact of screen media on key aspects of children and adolescents’ cognitive development. Highlighting how screen media impact cognitive development, the book addresses a topic often neglected amid societal concerns about pathological media use and vulnerability to media effects, such as aggression, cyber-bullying and Internet addiction. It addresses children and adolescents’ cognitive development involving their interactions with parents, early language development, imaginary play, attention, memory, and executive control, literacy and academic performance. Covers the impact of digital from both theoretical and practical perspectives Investigates effects of digital media on attention, memory, language and executive functioning Examines video games, texting, and virtual reality as contexts for learning Explores parent-child interactions around media Considers the development of effective educational media Addresses media literacy and critical thinking about media Considers social policy for increasing access to high quality education media and the Internet Provides guidance for parents on navigating children’s technology usage

How Context Matters

How Context Matters
Author: George Honadle
Publisher:
Total Pages: 244
Release: 1999
Genre: Nature
ISBN:

Presenting a unique method of looking at environmental policy formulation and implementation, George Honadle clarifies those elements of context that affect how policies work and outlines policymaking approaches that incorporate the important linkages among public policies, human behavior, and natural settings.