To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
In two field experiments conducted in Mississippi and Florida, we present novel evidence about how emotions can be harnessed to increase voter turnout. When we inform respondents that a partisan villain would be happy if they did not vote (for example, a Gloating Villain treatment), we find that anger is activated in comparison to other emotions and turnout increases by 1.7 percentage points. In a subsequent field experiment, we benchmark this treatment to a standard GOTV message, the social pressure treatment. Using survey experiments that replicate our field experimental treatments, we show that our treatment links the act of voting to anticipated anger. In doing so, we contribute the first in-the-field evidence of how we can induce emotions, which are commonly understood to be fleeting states, to shape temporally distant political behaviours such as voting.
Scholars often use survey experiments to evaluate political messages’ persuasive effects, but messages developed in the lab do not always persuade in real-world campaigns. In this research note, we report three experiments on one central obstacle in lab-to-field messaging applications: getting people’s attention. We first analyze a large-scale direct mail campaign run by an established non-profit that promotes conservative solutions to climate change. In this experiment, postcards with messages based on extant survey-experimental research did not cause changes in key climate attitudes. In a follow-up survey experiment, identical postcards induced attitude change— Re but only when participants were required to pay attention to them. A final field experiment highlights the difficulty of inducing attention; in another real-world campaign, postcards with eye-catching scratch-off panels performed no better than standard postcards. These findings illustrate the crucial role of attention and the complexity of translating messages developed in survey experiments into effective real-world campaigns.
In experimental social science, precise treatment effect estimation is of utmost importance, and researchers can make design choices to increase precision. Specifically, block-randomized and pre-post designs are promoted as effective means to increase precision. However, implementing these designs requires pre-treatment covariates, and collecting this information may decrease sample sizes, which in and of itself harms precision. Therefore, despite the literature’s recommendation to use block-randomized and pre-post designs, it remains unclear when to expect these designs to increase precision in applied settings. We use real-world data to demonstrate a counterintuitive result: precision gains from block-randomized or pre-post designs can withstand significant sample loss that may arise during implementation. Our findings underscore the importance of incorporating researchers’ practical concerns into existing experimental design advice.
Unlike with randomized controlled trials (RCTs) in clinical research, little has been said about the ethical principles that should regulate the use of RCTs in experimental development economics. One well-known principle in clinical research ethics is the principle of clinical equipoise. Some recent commentators suggest that an analogue of clinical equipoise should play a role in experimental development economics. In this article, I first highlight some difficulties with importing the concept to experimental development economics. I then argue that MacKay’s (2018, 2020) notion of policy equipoise avoids these difficulties and has a role to play in experimental development economics.
We study how culture and social structure influence bargaining behavior across gender, by exploring the negotiation culture in matrilineal and patriarchal societies using data from a laboratory experiment and a natural field experiment. One interesting result is that in both the actual marketplace and in the laboratory bargaining game, women in the matrilineal society earn more than men, at odds with years of evidence observed in the western world. We find that this result is critically driven by which side of the market the person is occupying: female (male) sellers in the matrilineal (patriarchal) society extract more of the bargaining surplus than male (female) sellers. In the buyer role, however, we observe no significant differences across societies.
This study designs a natural field experiment linked to a controlled laboratory experiment to examine the effectiveness of matching gifts and challenge gifts, two popular strategies used to secure a portion of the $200 billion annually given to charities. We find evidence that challenge gifts positively influence contributions in the field, but matching gifts do not. Methodologically, we find important similarities and dissimilarities between behavior in the lab and the field. Overall, our results have clear implications for fundraisers and provide avenues for future empirical and theoretical work on charitable giving.
Several studies have shown a relationship between the stocks of migrants and country-level investment in the home country; however the mechanism through which this relationship operates is still unexplored. We use a field experiment in which participants who are recent immigrants send information about risky decisions to others in their social network in their home country. The results demonstrate how this information influences decisions in the home country. We find that the advice given by family members and decisions made by friends significantly affects an individual’s risky decision-making.
We conducted a series of field experiments to investigate the ability of experimentally measured risk preferences to predict the contractual choices of workers in the real labour market. In a first set of experiments we twice measured workers’ risk preferences using the lottery approach of Holt and Laury (Am Econ Rev 92(5):1644–165, 2002). These workers subsequently participated in a contract-choice experiment, making 12 decisions. For each decision, the worker chose between his/her regular piece-rate contract and a particular fixed wage contract, each distinguished by the level of the fixed wage. One of the twelve decisions was then chosen at random and the worker was paid according to his/her choice for that decision over a period of two working days. We estimate the effect of risk preferences on contractual choices, controlling for measurement error and worker ability. Risk preferences effectively predict contract choices—risk-averse workers are more likely to select fixed-wage contracts. High-ability workers prefer piece-rates.
Group favoritism is typically directed toward in-group members and against out-group members, but these cross-group effects often vary. Little is known about why group effects on economic choices vary. We use a survey method developed in social psychology to measure stereotyped attitudes of one group toward another. These attitudes are then associated with prosociality in five experimental games (also using an unusual amount of individual-level sociodemographic control). We present evidence from an artificial field experiment of a majority group with high status (Vietnamese) exhibiting no disfavoritism toward a lower-status out-group (Khmer) and typical disfavoritism to a second out-group (Chinese). Both Vietnamese and Chinese groups see the Khmer as warm but incompetent, attitudes which seem to activate empathy rather than contempt. The results suggest that measuring between-group stereotype attitudes can be used to predict the sign of cross-group favoritism in other natural settings.
We report data on the experimental articles published from 2000 to 2021 in seven leading general-interest economics journals. We also look at time trends in the characteristics of the published experimental articles, including citations and the nationality of the authors. We find an overall increasing trend in the publication of non-lab experiments in all journals. By contrast, the share of lab experiments has more than halved in the AER and remained low in other Top five journals. The diverging trends for non-lab and lab experiments are not universal as the shares of both have increased in two other high-ranking economics journals (JEEA and EJ). We also observe some heterogeneities in publication, citations, rankings, and locations of authors' affiliations across journals and types of experiments.
Recruitment of representative and generalizable adult samples is a major challenge for researchers conducting economic field experiments. Limited access to representative samples or the high cost of obtaining them often leads to the recruitment of non-representative convenience samples. This research compares the findings from two field experiments involving 860 adults: one from a non-representative in-person convenience sample and one from a representative online counterpart. We find no meaningful differences in the key behaviors of interest between the two samples. These findings contribute to a growing body of literature demonstrating that non-representative convenience samples can be sufficient in certain contexts.
Field research refers to research conducted with a high degree of naturalism. The first part of this chapter provides a definition of field research and discusses advantages and limitations. We then provide a brief overview of observational field research methods, followed by an in-depth overview of experimental field research methods. We discuss randomization schemes of different types in field experimentation, such as cluster randomization, block randomization, and randomized rollout or waitlist designs, as well as statistical implementation concerns when conducting field experiments, including spillover, attrition, and noncompliance. The second part of the chapter provides an overview of important considerations when conducting field research. We discuss the psychology of construal in the design of field research, conducting non-WEIRD field research, replicability and generalizability, and how technological advances have impacted field research. We end by discussing career considerations for psychologists who want to get involved in field research.
Indoor air pollution is one of the leading causes of morbidity and mortality worldwide, but its sources and impacts are largely misunderstood by the public. In a randomised controlled trial including 281 households in France, we test two interventions aimed at changing indoor polluting behaviour by raising households’ awareness of health risks associated with indoor air pollution. While both generic and personalised information increased knowledge, only personalised information including social comparison feedback changed behaviour, leading to a reduction of indoor PM2.5 (particulate matter with an aerodynamic diameter ≤2.5 µm) emissions by 20% on average. Heterogeneous treatment effects show that this effect is concentrated on the most polluted households at baseline, for whom the reduction reaches 40%.
Many efforts to persuade others politically employ interpersonal conversations. A recurring question is whether the participants in such conversations are more readily persuaded by others who share their demographic characteristics. Echoing concerns that individuals have difficulties communicating across differences, research finds that individuals perceive demographically similar people as more trustworthy, suggesting shared demographics could facilitate persuasion. In a survey of practitioners and scholars, we find many share these expectations. However, dual-process theories suggest that messenger attributes are typically peripheral cues that should not influence persuasion when individuals are effortfully thinking, such as during interpersonal conversations. Supporting this view, we analyze data from eight experiments on interpersonal conversations across four topics (total N = 6, 139) and find that shared demographics (age, gender, or race) do not meaningfully increase their effects. These results are encouraging for the scalability of conversation interventions, and suggest voters can persuade each other across differences.
We study how an intervention combining youth intergroup contact and sports affects intergroup relations in the context of an active conflict. We first conduct a randomized controlled trial (RCT) of one-year program exposure in Israel. To track effects of a multiyear exposure, we then use machine-learning techniques to fuse the RCT with the observational data gathered on multiyear participants. This analytical approach can help overcome frequent limitations of RCTs, such as modest sample sizes and short observation periods. Our evidence cannot affirm a one-year effect on outgroup regard and ingroup regulation, although we estimate benefits of multiyear exposure among Jewish-Israeli youth, particularly boys. We discuss implications for interventions in contexts of active conflict and group status asymmetry.
Politicians are exposed to a constant flow of information about societal problems. However, they have limited resources and need to prioritize. So, which information should they pay attention to? Previous research identifies four types of information that may matter: public concern about a problem, problem attention by rival parties, news stories about problems, and statistical problem indicators. We are the first to contrast the four types of information through a field experiment with more than 6,000 candidates and multiple elite interviews in Denmark. The candidates received an email invitation to access a specially tailored report that randomly highlighted one of the four types of information. Statistical indicators and public opinion were accessed the most (26.9 per cent and 26.5 per cent of candidates in the two conditions). Our results provide new and important evidence about the types of information politicians consider when addressing societal problems.
This chapter tests two ways of overcoming uncertainty about relationality – having potential collaborators directly communicate how they will relate to each other, and using third parties such as matchmakers and boundary spanners. Both are useful for creating valuable new collaborative relationships, especially between people who begin as strangers. In addition, this chapter also presents evidence showing the impact of new collaborative relationships on strategic decision-making. Data in this chapter come from a variety of national surveys, field experiments, and case comparisons.
While experiments on elections represent a popular tool in social science, the possibility that experimental interventions could affect who wins office remains a central ethical concern. I formally characterize electoral experimental designs to derive an upper bound on aggregate electoral impact under different assumptions about interference. I then introduce a decision rule based on comparison of this bound to predicted election outcomes to determine whether an experiment should be implemented. Researchers can mitigate the possibility of affecting aggregate outcomes by reducing the saturation of treatment or focusing experiments in districts and electoral systems where treated voters are less likely to be pivotal. These conditions identify novel trade-offs between adhering to ethical commitments and the statistical power and external validity of electoral experiments. More broadly, this paper shows that the formalization of an ethical objective facilitates a closer mapping between ethical considerations and experimental design than is currently practiced.
This study adds to the analogic perspective-taking literature by examining whether an online perspective-taking intervention affects both antisemitic attitudes and behaviors – in particular, engagement with antisemitic websites. Subjects who were randomly assigned to the treatment viewed a 90-s video of a college student describing an experience with antisemitism and reflected on its similarity to their own experiences. In a survey, treated subjects reported greater feelings of sympathy (+29 p.p.), more positive feelings toward Jews, a greater sense that Jews are discriminated against, and more support for policy solutions (+2–4 p.p.). However, these effects did not persist after 14 days. Examining our subjects’ web browsing data, we find a 5% reduction in time spent viewing antisemitic content during the posttreatment period and some limited, suggestive evidence of effects on the number of site visits. These findings provide the first evidence that perspective-taking interventions may affect online browsing behavior.
Edited by
Cait Lamberton, Wharton School, University of Pennsylvania,Derek D. Rucker, Kellogg School, Northwestern University, Illinois,Stephen A. Spiller, Anderson School, University of California, Los Angeles
This chapter assesses how consumer research defines a “field experiment,” takes a look at trends in field experimentation in consumer research journals, explores the advantages and shortcomings of field experimentation, and assesses the status and value of open science practices for field experiments. These assessments render four insights. First, the field of consumer research does not have a consensus on the definition of field experiments, though an established taxonomy helps us determine the extent to which any given field experiment differs from traditional lab settings. Second, about 7 ercent of the published papers in one of the top consumer psychology journals include some form of field experiment – a small but growing proportion. Third, although field experimentation can be useful for providing evidence of external validity and estimating real-world effect sizes, no single lab or field study offers complete generalizable insight. Instead, each well-designed, high-powered study adds to the collection of findings that converge to advance our understanding. Finally, open science practices are useful for bridging scientific findings in field experiments with real-life applications.