Professor Robert D. Metcalfe

Robert D. Metcalfe

Professor of International and Public Affairs

SIPA Professorship of Energy Policy  ·  Columbia University

Applied Microeconomics Environmental & Energy Economics Behavioral & Experimental Economics Labor / Personnel Economics Public Economics
J. Political Economy Forthcoming
Management and Productivity in Retail

Metcalfe, R., Sollaci, A., Syverson, C.


Abstract

In many sectors, research has established that management explains a significant portion of productivity differences across organizations. A remaining question, however, is whether it is managers themselves or firm-wide management practices that matter. We shed light on this question by analyzing store-level data from two multibillion-dollar retail companies. In this setting, managers move between stores, but management practices are set by firm policy and store attributes are largely fixed, allowing us to isolate managers’ personal roles in determining store performance. We have three high-level findings: (i) managers affect and explain 25–35% of the variance of store-level productivity; (ii) negative assortative matching between managers and stores, which may reflect both firms’ decisions and a selection-driven bias that we characterize as novel and argue might apply in other settings using AKM-style movers designs; and (iii) moving from a below median to an above median manager raises store-level productivity by around 10% after several months.

Citation

@article{metcalfe_management_retail,
  author  = {Metcalfe, Robert D. and Sollaci, Alexandre and Syverson, Chad},
  title   = {Management and Productivity in Retail},
  journal = {Journal of Political Economy},
  note    = {Forthcoming}
}
American Economic Review 2026 · Lead Article
A Welfare Analysis of Policies Impacting Climate Change

Hahn, R., Hendren, N., Metcalfe, R., Sprung-Keyser, B.


Abstract

We study the welfare impacts of 96 climate-related tax and spending policies. We extend and apply the marginal value of public funds (MVPF) framework, most notably providing a new method for incorporating learning-by-doing spillovers. We find subsidies for the production of clean energy (such as wind production tax credits) have higher MVPFs than all other subsidies in our sample, including EV subsidies. Conservation nudges have large MVPFs when targeting regions with dirty grids. Fuel taxes and cap-and-trade policies are highly efficient means of raising revenue. We also construct traditional cost-per-ton estimates and compare and contrast the lessons they provide.

Citation

@article{hahn_welfare_climate_2026,
  author  = {Hahn, Robert W. and Hendren, Nathaniel and Metcalfe, Robert D. and Sprung-Keyser, Ben},
  title   = {A Welfare Analysis of Policies Impacting Climate Change},
  journal = {American Economic Review},
  year    = {2026},
  volume  = {116},
  number  = {7},
  pages   = {2368--2421},
  doi     = {10.1257/aer.20250166}
}
Review of Economic Studies 2026
Do the Effects of Nudges Persist? Theory and Evidence from 38 Natural Field Experiments

Brandon, A., Ferraro, P., List, J., Metcalfe, R., Price, M., Rundhammer, F.


Abstract

We formalize a research design to uncover the mechanisms underlying long-term reductions in energy consumption caused by a widely implemented nudge. We consider two channels: technology adoption and habit formation. Using data from 38 natural field experiments, we isolate the role of technology adoption by comparing treatment and control homes after the initial resident moves, which discontinues the treatment for a home. We find that fully half of energy reductions persist in the home after treatment ends and show this persistence is consonant with a technology adoption channel. The role of technology in creating persistent behavior change has important implications for designing behavioral interventions and evaluating their long-term social impacts.

Citation

@article{brandon_nudges_persist_2026,
  author  = {Brandon, Alec and Ferraro, Paul J. and List, John A. and Metcalfe, Robert D. and Price, Michael K. and Rundhammer, Florian},
  title   = {Do the Effects of Nudges Persist? Theory and Evidence from 38 Natural Field Experiments},
  journal = {Review of Economic Studies},
  year    = {2026},
  doi     = {10.1093/restud/rdag012}
}
Economic Journal 2026
Do Water Audits Work?

Akesson, J., Hahn, R., Kochhar, R., Metcalfe, R.


Abstract

Water suppliers are showing greater interest in using residential water audits to promote conservation. Yet there is limited causal evidence on their effectiveness, persistence, and welfare implications. We address this gap using a natural field experiment in the United Kingdom that randomly assigns about 45,000 households to receive different behavioural encouragements to complete an online home water audit. Our analysis yields three main findings. First, financial incentives substantially increase audit take-up and lead to large short-run reductions in water use: among compliers, consumption falls by about 17 per cent over a two-month period. The size of the incentive matters for participation but not for the magnitude of conservation. Second, conservation effects attenuate rapidly, becoming undetectable after roughly two months. As a result, the intervention yields small welfare gains, with per capita net benefits typically below £1 under a wide range of assumptions. Third, targeting high-use households roughly doubles short-run conservation effects but remains insufficient to generate sizable welfare gains because conservation does not persist. Overall, while audits and incentives induce meaningful short-run conservation, their policy value depends critically on whether these effects persist.

Citation

@article{akesson_water_audits_2026,
  author  = {Akesson, Jesper and Hahn, Robert W. and Kochhar, R. and Metcalfe, Robert D.},
  title   = {Do Water Audits Work?},
  journal = {Economic Journal},
  year    = {2026},
  doi     = {10.1093/ej/ueag124}
}
J. Public Economics 2026
Race and Redistribution in the United States: An Experimental Analysis

Akesson, J., Hahn, R., Metcalfe, R., Rasooly, I.


Abstract

Scholars have suggested that White American support for welfare is influenced by their beliefs about the racial composition of welfare recipients. In this paper, we test this hypothesis using two experiments (n=9,775) that induce random variation in participants’ beliefs about the racial distribution of welfare recipients. In both experiments, we obtain evidence that exogenously increasing beliefs about the share of welfare recipients who are Black reduces support for welfare. We also use our experiments to study the effect of ‘priming’ participants to think about race, the accuracy of beliefs about the racial distribution of welfare recipients, and the mechanisms that underpin our results.

Citation

@article{akesson_race_redistribution_2026,
  author  = {Akesson, Jesper and Hahn, Robert W. and Metcalfe, Robert D. and Rasooly, Itzhak},
  title   = {Race and Redistribution in the United States: An Experimental Analysis},
  journal = {Journal of Public Economics},
  year    = {2026},
  volume  = {255},
  pages   = {105555},
  doi     = {10.1016/j.jpubeco.2025.105555}
}
Management Science 2023
Nudging Timely Wage Reporting: Field Experimental Evidence from the U.S. SSI Program

Zhang, C.Y., Hemmeter, J., Kessler, J.B., Metcalfe, R., Weathers, R.


Abstract

We study a large-scale (n = 50,000) natural field experiment implemented by the U.S. Social Security Administration aimed at increasing the timely and accurate self-reporting of wages by Supplemental Security Income (SSI) recipients. A letter reminding SSI recipients of their wage reporting responsibilities significantly increased both the likelihood of reporting any earnings and the total earnings reported. However, the specific letter content—providing social information or highlighting the salience of penalties—had no systematic effect. We develop a conservative estimate that the letters generated roughly $5.91 in savings per dollar spent, highlighting the value of such a nudge in this important context.

Citation

@article{zhang_wage_reporting_2023,
  author  = {Zhang, C. Yiwei and Hemmeter, Jeffrey and Kessler, Judd B. and Metcalfe, Robert D. and Weathers, Robert},
  title   = {Nudging Timely Wage Reporting: Field Experimental Evidence from the U.S. Supplemental Security Income Program},
  journal = {Management Science},
  year    = {2023},
  volume  = {69},
  number  = {3},
  pages   = {1341--1353},
  doi     = {10.1287/mnsc.2022.4645}
}
American Economic Review 2022
Measuring the Welfare Effects of Shame and Pride

Butera, L., Metcalfe, R., Morrison, W., Taubinsky, D.


Abstract

Public recognition is frequently used to motivate desirable behavior, yet its welfare effects—such as costs of shame or gains from pride—are rarely measured. We develop a portable empirical methodology for measuring and monetizing social image utility, and we deploy it in experiments on exercise and charitable behavior. In all experiments, public recognition motivates desirable behavior but creates highly unequal image payoffs. High-performing individuals enjoy significant utility gains, while low-performing individuals incur significant utility losses. We estimate structural models of social signaling, and we use the models to explore the social efficiency of public recognition policies.

Citation

@article{butera_shame_pride_2022,
  author  = {Butera, Luigi and Metcalfe, Robert and Morrison, William and Taubinsky, Dmitry},
  title   = {Measuring the Welfare Effects of Shame and Pride},
  journal = {American Economic Review},
  year    = {2022},
  volume  = {112},
  number  = {1},
  pages   = {122--68},
  doi     = {10.1257/aer.20190433}
}
J. Risk and Uncertainty 2022
Fatalism, Beliefs, and Behaviors During the COVID-19 Pandemic

Akesson, J., Ashworth-Hayes, S., Hahn, R., Metcalfe, R., Rasooly, I.


Abstract

Little is known about how people’s beliefs concerning the Coronavirus Disease 2019 (COVID-19) influence their behavior. To shed light on this, we conduct an online experiment (n = 3,610) with US and UK residents. Participants are randomly allocated to a control group or to one of two treatment groups. The treatment groups are shown upper- or lower-bound expert estimates of the infectiousness of the virus. We present three main empirical findings. First, individuals dramatically overestimate the dangerousness and infectiousness of COVID-19 relative to expert opinion. Second, providing people with expert information partially corrects their beliefs about the virus. Third, the more infectious people believe that COVID-19 is, the less willing they are to take protective measures, a finding we dub the “fatalism effect”. We develop a formal model that can explain the fatalism effect and discuss its implications for optimal policy during the pandemic.

Citation

@article{akesson_fatalism_2022,
  author  = {Akesson, Jesper and Ashworth-Hayes, Sam and Hahn, Robert and Metcalfe, Robert and Rasooly, Itzhak},
  title   = {Fatalism, Beliefs, and Behaviors During the COVID-19 Pandemic},
  journal = {Journal of Risk and Uncertainty},
  year    = {2022},
  volume  = {64},
  number  = {2},
  pages   = {147--190},
  doi     = {10.1007/s11166-022-09375-y}
}
American Economic Review 2021
Efficiency and Equity Impacts of Energy Subsidies

Hahn, R., Metcalfe, R.


Abstract

Economic theory suggests that energy subsidies can lead to excessive consumption and environmental degradation. However, the precise impact of energy subsidies is not well understood. We analyze a large energy subsidy: the California Alternate Rates for Energy (CARE). CARE provides a price reduction for low-income consumers of natural gas and electricity. Using a natural field experiment, we estimate the price elasticity of demand for natural gas to be about −0.35 for CARE customers. An economic model of this subsidy yields three results. First, the natural gas subsidy appears to reduce welfare. Second, the economic impact of various policies, such as cap-and-trade, depends on whether prices for various customers move closer to the marginal social cost. Third, benefits to CARE customers need to increase by 6 percent to offset the costs of the program.

Citation

@article{hahn_energy_subsidies_2021,
  author  = {Hahn, Robert W. and Metcalfe, Robert D.},
  title   = {Efficiency and Equity Impacts of Energy Subsidies},
  journal = {American Economic Review},
  year    = {2021},
  volume  = {111},
  number  = {5},
  pages   = {1658--88},
  doi     = {10.1257/aer.20180441}
}
Economics of Education Review 2021
Understanding the Response to Financial and Non-financial Incentives in Education

Burgess, S., Metcalfe, R., Sadoff, S.


Abstract

We analyze the impact on high-stakes assessments of incentivizing students’ effort in a field experiment with over 10,000 high school students. We contribute to the literature by using our rich data and machine learning techniques to explore treatment heterogeneity; by comparing financial and non-financial rewards in rewarding effort rather than grades; and by using high-stakes outcomes. We find little average impact of incentives in the overall population, but we identify a “right tail” of highly responsive students: in the upper half of the responsiveness distribution, test scores improve by 0.1–0.2 SD, about half the attainment gap between poor and non-poor students.

Citation

@article{burgess_incentives_education_2021,
  author  = {Burgess, Simon and Metcalfe, Robert and Sadoff, Sally},
  title   = {Understanding the Response to Financial and Non-financial Incentives in Education: Field Experimental Evidence Using High-Stakes Assessments},
  journal = {Economics of Education Review},
  year    = {2021},
  volume  = {85},
  pages   = {102195},
  doi     = {10.1016/j.econedurev.2021.102195}
}
J. Political Economy 2020 · Lead Article
The Impact of Management Practices on Employee Productivity: A Field Experiment with Airline Captains

Gosnell, G., List, J., Metcalfe, R.


Abstract

Increasing evidence indicates the importance of management in determining firms' productivity. Yet causal evidence regarding the effectiveness of management practices is scarce, especially for skilled labor in the developed world. In a field experiment measuring commercial airline captains’ productivity, we test four distinct management practices: performance monitoring, performance feedback, target setting, and prosocial incentives. These practices—particularly monitoring and target setting—significantly increase captains' productivity on the targeted fuel-saving dimensions, with positive spillovers on job satisfaction and CO2 emissions. The study reveals an uncharted research opportunity to delve into the black box of firms to examine the determinants of productivity among skilled labor.

Citation

@article{gosnell_airline_captains_2020,
  author  = {Gosnell, Greer K. and List, John A. and Metcalfe, Robert D.},
  title   = {The Impact of Management Practices on Employee Productivity: A Field Experiment with Airline Captains},
  journal = {Journal of Political Economy},
  year    = {2020},
  volume  = {128},
  number  = {4},
  pages   = {1195--1233},
  doi     = {10.1086/705375}
}
PNAS 2019
Testing for Crowd Out in Social Nudges: Evidence from a Natural Field Experiment in the Market for Electricity

Brandon, A., List, J., Metcalfe, R., Price, M., Rundhammer, F.


Abstract

This study considers the response of household electricity consumption to social nudges during peak load events. Our investigation considers two social nudges. The first targets conservation during peak load events, while the second promotes aggregate conservation. Using data from a natural field experiment with 42,100 households, we find that both social nudges reduce peak load electricity consumption by 2 to 4% when implemented in isolation and by nearly 7% when implemented in combination. These findings suggest an important role for social nudges in the regulation of electricity markets and a limited role for crowd out effects.

Citation

@article{brandon_crowd_out_2019,
  author  = {Brandon, Alec and List, John A. and Metcalfe, Robert D. and Price, Michael K. and Rundhammer, Florian},
  title   = {Testing for Crowd Out in Social Nudges: Evidence from a Natural Field Experiment in the Market for Electricity},
  journal = {Proceedings of the National Academy of Sciences},
  year    = {2019},
  volume  = {116},
  pages   = {5293--5298},
  doi     = {10.1073/pnas.1802874115}
}
J. Public Economics 2019
Quantifying the Intangible Impact of the Olympics Using Subjective Well-Being Data

Dolan, P., Kavetsos, G., Krekel, C., Mavridis, D., Metcalfe, R., Senik, C., Szymanski, S., Ziebarth, N.


Abstract

Hosting the Olympic Games costs billions of taxpayer dollars. Following a quasi-experimental setting, this paper assesses the intangible impact of the London 2012 Olympics, using a novel panel of 26,000 residents in London, Paris, and Berlin during the summers of 2011, 2012, and 2013. We show that hosting the Olympics increases subjective well-being of the host city’s residents during the event, particularly around the times of the opening and closing ceremonies. However, we do not find much evidence for legacy effects. Estimating residents’ implicit willingness-to-pay for the event, we do not find that it was worth it for London alone, but a modest wellbeing impact on the rest of the country would make hosting worth the costs.

Citation

@article{dolan_olympics_2019,
  author  = {Dolan, Paul and Kavetsos, Georgios and Krekel, Christian and Mavridis, Dimitris and Metcalfe, Robert and Senik, Claudia and Szymanski, Stefan and Ziebarth, Nicolas R.},
  title   = {Quantifying the Intangible Impact of the Olympics Using Subjective Well-Being Data},
  journal = {Journal of Public Economics},
  year    = {2019},
  volume  = {177},
  doi     = {10.1016/j.jpubeco.2019.07.002}
}
J. Public Economics 2019
Students' Effort and Educational Achievement: Using the Timing of the World Cup to Vary the Value of Leisure

Metcalfe, R., Burgess, S., Proud, S.


Abstract

We study the effect of a sharp, exogenous, and repeated change in the value of leisure on educational achievement, arising from the overlap of major international football tournaments with high-stakes tests. Using administrative data covering almost all students in England, we find a significant negative average effect of the tournament on exam performance. The odds of reaching the achievement benchmark fall by 12% on average, considerably more for students likely to be interested in football. Analysis of within-student variation shows a 0.02 SD fall in grades, 0.06 SD for the interested. We interpret our results as reflecting changes in student effort.

Citation

@article{metcalfe_world_cup_2019,
  author  = {Metcalfe, Robert and Burgess, Simon and Proud, Steven},
  title   = {Students' Effort and Educational Achievement: Using the Timing of the World Cup to Vary the Value of Leisure},
  journal = {Journal of Public Economics},
  year    = {2019},
  volume  = {172},
  pages   = {111--126},
  doi     = {10.1016/j.jpubeco.2018.12.006}
}
J. Public Economics 2017
The Behavioralist as Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance

Hallsworth, M., List, J., Metcalfe, R., Vlaev, I.


Abstract

This paper presents results from two large-scale natural field experiments that tested the effect of social norm messages on tax compliance. Using administrative data from > 200,000 individuals in the United Kingdom, we show that including social norm messages in standard reminder letters increases payment rates for overdue tax. This result offers a rare example of social norm messages affecting tax compliance behavior in a real world setting. We find no evidence that loss framing is more effective than gain framing. Descriptive norms appear to be more effective than injunctive norms. Messages referring to public services or financial information also significantly increased payment rates. The field experiments accelerated the collection of tax revenue at little cost.

Citation

@article{hallsworth_tax_collector_2017,
  author  = {Hallsworth, Michael and List, John A. and Metcalfe, Robert D. and Vlaev, Ivo},
  title   = {The Behavioralist as Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance},
  journal = {Journal of Public Economics},
  year    = {2017},
  volume  = {148},
  pages   = {14--31},
  doi     = {10.1016/j.jpubeco.2017.02.003}
}
Economic Journal 2011
Destruction and Distress: Using a Quasi-Experiment to Show the Effects of the September 11 Attacks on Mental Well-Being in the United Kingdom

Metcalfe, R., Powdthavee, N., Dolan, P.


Abstract

Using a longitudinal household panel dataset in the UK, where a significant proportion of the interviews are conducted in September each year, we are able to show that the attacks of September 11 resulted in lower levels of subjective well-being for those interviewed after that date in 2001 compared with those interviewed before it. This quasi-experiment provides one of the first examples of the impact of a terrorist attack in one country on well-being in another country.

Citation

@article{metcalfe_destruction_distress_2011,
  author  = {Metcalfe, Robert and Powdthavee, Nattavudh and Dolan, Paul},
  title   = {Destruction and Distress: Using a Quasi-Experiment to Show the Effects of the September 11 Attacks on Mental Well-Being in the United Kingdom},
  journal = {Economic Journal},
  year    = {2011},
  volume  = {121},
  number  = {550},
  pages   = {F81--F103},
  doi     = {10.1111/j.1468-0297.2010.02416.x}
}
R&R · American Economic Review Expecting Climate Change: A Nationwide Field Experiment in the Housing Market

Fairweather, D., Kahn, M., Metcalfe, R., Sandoval-Olascoaga, S.


Abstract

Climate change increases property risk in the United States, yet home buyers lack affordable, location-specific risk information. We study the causal effects of providing flood risk information using a field experiment conducted with Redfin. Redfin randomly assigned 17 million users to receive flood risk disclosures for properties they viewed. Flood risk information changed which properties buyers searched for, bid on, and closed on, shifting them toward lower-risk homes without detectable changes in other observable property attributes. Effects were stronger in high-risk areas. Information provision shifted prices and the hedonic equilibrium, suggesting proactive climate adaptation.

Citation

@unpublished{fairweather_expecting_climate,
  author = {Fairweather, Daryl and Kahn, Matthew E. and Metcalfe, Robert D. and Sandoval-Olascoaga, Sebastian},
  title  = {Expecting Climate Change: A Nationwide Field Experiment in the Housing Market},
  note   = {Revise and resubmit, American Economic Review}
}
Conditionally Accepted · AEJ: Economic Policy The Value of Time in the United States: Estimates from Nationwide Natural Field Experiments

Goldszmidt, A., List, J., Metcalfe, R., Muir, I., Smith, K., Wang, J.

Conditionally Accepted · AEJ: Economic Policy The Human Perils of Scaling Smart Technologies: Evidence from Field Experiments

Brandon, A., Clapp, C., List, J., Metcalfe, R., Price, M.

Conditionally Accepted · AEJ: Economic Policy Decarbonizing Heat: The Impact of Heat Pumps and a Time-of-Use Heat Pump Tariff on Energy Demand

Bernard, L., Hackett, A., Metcalfe, R., Schein, A.


Abstract

Heat pumps have been proposed as the leading technology in the electrification of domestic heat and therefore could play a crucial part in decarbonizing energy systems. However, there is limited causal evidence on how they affect energy demand and how energy prices can optimize their use. Leveraging a staggered rollout of heat pumps by a large energy supplier in Great Britain, we show: (1) heat pumps reduce average household gas use by 98% and increase electricity use by 50%, leading to a 72% reduction in carbon emissions from household energy consumption over a typical asset lifetime; (2) a time-of-use tariff (a retail electricity pricing plan) designed for heat pumps can halve electricity demand during the evening peak to enhance grid flexibility; (3) the marginal value of public funds for the current heat pump subsidy in Great Britain is £1.23 per £1 of government spending. Overall, we find that heat pumps can effectively decarbonize heat and subsidies can be welfare-enhancing.

Citation

@unpublished{bernard_decarbonizing_heat,
  author = {Bernard, Louise and Hackett, Andy and Metcalfe, Robert D. and Schein, Andrew R.},
  title  = {Decarbonizing Heat: The Impact of Heat Pumps and a Time-of-Use Heat Pump Tariff on Energy Demand},
  note   = {Conditionally accepted, American Economic Journal: Economic Policy}
}
Conditionally Accepted · Accounting, Organizations and Society How Resolving Enforcement Ambiguity Reduces Tax Compliance

Floyd, E., Hallsworth, M., List, J., Metcalfe, R., Rotaru, K., Vlaev, I.


Abstract

Tax authorities often leave the consequences of non-compliance unspecified. Enforcement letters warn of further action without stating what it is, and penalty notices give maxima set case by case. We examine whether specifying those consequences raises or lowers compliance, and why, in four experiments spanning both behavioral margins of the tax gap, from the field to physiological measurement. In a field experiment with HM Revenue and Customs, letters randomized to more than 200,000 taxpayers with outstanding income-tax debts increased payment when they left the consequences unspecified, but not when they specified a financial or an administrative consequence. In an online payment experiment with 2,050 taxpayers across fourteen conditions, of whom 1,194 formed the factorial design carrying the principal test, resolving the maximum fine lowered the stated likelihood of paying, whether the revealed maximum was modest or severe, which statistical updating about the penalty does not accommodate and ambiguity aversion does. An incentivized experiment with 827 participants reproduced the effect on an income-reporting decision with money at stake, extending it to the reporting margin. A laboratory experiment with 239 participants, using eye tracking and pupillometry, found that enforcement messages differed in the autonomic arousal they produced and not in the visual attention they received, and that pupillary response accounts for part of the association with compliance. Ambiguity about enforcement consequences, over and above penalty magnitude, is therefore a determinant of compliance, operating through affective response rather than belief revision. The findings have direct implications for how tax authorities disclose penalty schedules.

Citation

@unpublished{floyd_enforcement_ambiguity,
  author = {Floyd, Eric and Hallsworth, Michael and List, John A. and Metcalfe, Robert D. and Rotaru, Kristian and Vlaev, Ivo},
  title  = {How Resolving Enforcement Ambiguity Reduces Tax Compliance},
  note   = {Conditionally accepted, Accounting, Organizations and Society}
}
R&R · J. Environmental Economics and Management Smart Meters: Do Their Prices Matter to Their Adoption and Do They Save Energy?

List, J., Metcalfe, R., Price, M.

The Impact of Dynamic Prices on Electric Vehicle Public Charging Demand: Evidence from a Natural Field Experiment

Bernard, L., Hackett, A., Metcalfe, R., Panzone, L., Schein, A.


Abstract

Understanding how to effectively influence electric vehicle (EV) charging behavior is critical for managing electricity grids powered by high levels of variable renewable generation. We present results from a large-scale natural field experiment conducted in the United Kingdom, involving approximately 110,000 EV customers and 60% of the country’s public charging infrastructure. Within this network, we applied a price decrease to approximately one-fifth of chargers to bring their prices closer to the marginal cost of electricity in low-cost hours in Great Britain. Customers were randomly assigned to different price levels, allowing us to estimate the causal effect of price on charging demand and derive elasticities of short-run behavioral responses. Customers were responsive to price: a 40% reduction in charging was equivalent to an arc price elasticity of -0.90, while a 15% price cut was equivalent to an arc price elasticity of -0.85. Our findings suggest that dynamic pricing for public EV charging generated large consumer welfare gains.

Citation

@unpublished{bernard_ev_dynamic_prices,
  author = {Bernard, Louise and Hackett, Andy and Metcalfe, Robert D. and Panzone, Luca A. and Schein, Andrew R.},
  title  = {The Impact of Dynamic Prices on Electric Vehicle Public Charging Demand: Evidence from a Natural Field Experiment},
  note   = {Working paper}
}
AI in Charge: Large-Scale Experimental Evidence on Electric Vehicle Charging Demand

Metcalfe, R., Simpson, C., Schein, A., Sun, Y.


Abstract

One of the promising opportunities offered by AI to support the decarbonization of electricity grids is to align demand with low-carbon supply, yet there is little causal evidence on household acceptance of AI managed control, and its impact on their consumption. We evaluated the effects of the world’s largest AI managed EV charging tariff (a retail electricity pricing plan) using a large-scale natural field experiment. This tariff is designed to optimize EV charging by dynamically controlling charging in response to real-time wholesale electricity prices. We randomized financial incentives to encourage enrollment onto the tariff and observed consumption for more than a year. We found that the tariff led to a 42% reduction in household electricity demand during peak hours, with 100% of this demand shifted to lower-cost and lower-carbon-intensity periods. The tariff generated substantial consumer savings, while demonstrating potential to lower producer costs, energy system costs, and carbon emissions through significant load shifting. Overrides of the AI algorithm were low, suggesting that this tariff was likely more efficient than a real-time-pricing tariff without AI, given our theoretical framework. We also showed that experimental estimates differed meaningfully from those obtained via non-randomized difference-in-differences analysis, due to differences in the potential outcomes of the samples in the two evaluation strategies, although we can reconcile the estimates somewhat with observables. Our findings highlight the potential for scalable managed charging and its substantial welfare gains for the electricity system and society.

Citation

@unpublished{metcalfe_ai_in_charge,
  author = {Metcalfe, Robert D. and Schein, Andrew R. and Simpson, Cohen R. and Sun, Yixin},
  title  = {AI in Charge: Large-Scale Experimental Evidence on Electric Vehicle Charging Demand},
  note   = {Working paper}
}
Critical Peak Rewards: Evidence from a Nationwide Demand Response Program

Bernard, L., Metcalfe, R., Schein, A.R.


Abstract

Demand flexibility at scale is likely to be an important part of the future energy system. This study evaluated the world’s first nationwide domestic and commercial demand flexibility program. We analyzed the policy using a natural field experiment, with a sample of 2.6 million, assigning 119,999 customers to a control group and the rest to receive randomized encouragement to sign up to the demand flexibility program. The program paid consumers to reduce their demand below a predicted baseline at peak demand across 16 events (i.e., when the system was stressed) during the Winter of 2023–24. Customers who opted into events reduced demand during events by 23.1% among compliers, at an average cost for the system operator of £2,325 per MWh. The adoption of solar panels and batteries, heat pumps, and EVs all increased demand response.

Citation

@unpublished{bernard_critical_peak_rewards,
  author = {Bernard, Louise and Metcalfe, Robert D. and Schein, Andrew R.},
  title  = {Critical Peak Rewards: Evidence from a Nationwide Demand Response Program},
  note   = {Working paper}
}
A Demand-Side Alternative to Renewable Curtailment: Natural Field Experimental Evidence from Two Countries

Lopez, D., Metcalfe, R., Schein, A., Sun, Y.


Abstract

As renewable generation plays a growing role in the energy system, periods of negative wholesale electricity prices are becoming increasingly common and are expected to grow dramatically over the next ten years. Traditionally, system operators respond by paying generators, especially renewables, to curtail production, or mandating that they do so without compensation. In this study, we propose and test a novel alternative: exposing consumers to free and negative prices to stimulate demand when supply is abundant. We implemented large-scale nationwide natural field experiments simultaneously in Great Britain and Spain, with roughly 60,000 residential customers in each country randomized to receive varying financial incentives to “turn up” their electricity. We found that demand increased substantially as prices fell to zero, but paying customers to consume beyond zero price yielded little additional response. Households with electric vehicles and rooftop solar had a larger elasticity than households without such technologies, suggesting demand turn-up becomes more effective as households adopt low-carbon technologies. In Great Britain, consumption was largely shifted from adjacent hours, while in Spain the increase appeared to represent net new demand. We develop a welfare framework showing conditions under which demand turn-up improves on curtailment; we find that by inducing additional consumption in periods and locations where the marginal cost of supply is low, demand turn-up generates welfare gains that curtailment leaves uncaptured.

Citation

@unpublished{lopez_demand_turnup,
  author = {Lopez Garcia, Daniel and Metcalfe, Robert D. and Schein, Andrew R. and Sun, Yixin},
  title  = {A Demand-Side Alternative to Renewable Curtailment: Natural Field Experimental Evidence from Two Countries},
  note   = {Working paper}
}
Welfare Effects of Shifting Public Transit Demand

Hahn, R., Metcalfe, R., Tam, E.

The Impact of Fake Reviews on Demand and Welfare

Akesson, J., Hahn, R., Metcalfe, R., Monti-Nussbaum, M.

Using Big Data to Estimate Consumer Surplus: The Case of Uber

Cohen, P., Hahn, R., Hall, J., Metcalfe, R., Levitt, S.

Can Bad Norms Be Good?

Akesson, J., Conti, R., Hahn, R., Metcalfe, R., Rasooly, I.


Abstract

Descriptive social norm interventions have been used to address a wide range of policy challenges, from encouraging resource conservation to promoting female labor force participation. In this paper, we report the results of a natural field experiment (n = 5,360) that randomly exposes participants to different signals about the share of others who have signed up as advocates for a charity. Consistent with prior work, we find that suggesting that everyone else has signed up increases the likelihood that participants themselves sign up as advocates. However, we also show that suggesting that no one else has signed up increases sign-up rates. We replicate these findings in a follow-up experiment (n = 5,042) that investigates why it can be effective to reveal ‘bad’ norms.

Citation

@unpublished{akesson_bad_norms,
  author = {Akesson, Jesper and Conti, Rena and Hahn, Robert W. and Metcalfe, Robert D. and Rasooly, Itzhak},
  title  = {Can Bad Norms Be Good?},
  note   = {Working paper}
}
The Impact of Solar and Battery on Energy Demand: Evidence from a Nationwide Natural Field Experiment

Metcalfe, R., Schein, A., Sun, Y.

Information Frequency, Cognition, and Risk: A Natural Field Experiment with Professional Traders

Larson, F., List, J., Metcalfe, R., Rodemeier, M.

Allocation or Price: The Case of US Real Estate Agents

Fairweather, D., Metcalfe, R., Nguyen, T.M.A.

Impact of Management on Maritime Productivity and Emissions

Du, X., Metcalfe, R.

Seeing Stars: Multiple Hypothesis Testing in Economics

Butera, L., Kennedy, A., List, J., Metcalfe, R.

The Economics of Energy
Masters level · Columbia University, SIPA
Syllabus
Experimental Economics
PhD level · Columbia University, Economics & SIPA
Syllabus
Current
Clara Berestycki Columbia SIPA
Fanyu Wang Columbia SIPA
Charlie Hutchinson UCLA
Andrew Schein LSE
Placed
Hannah Farkas Columbia SIPA, 2026
Duke post-doc → McMaster AP
Anna Papp Columbia SIPA, 2025
MIT Econ post-doc → UCSB Bren AP
Francesco Gabriele USC, 2025
HKUST AP
Ruozi Song USC, 2023
World Bank Research Group, Research Economist
Pre-doctoral Students
Navya Kumar Columbia SIPA, 2024–
Lukas Puschnig USC, 2023–2024
LMU Munich PhD
Lillian Bartholomew USC, 2022–2024
RAND PhD
Xidi Zhang USC, 2022–2024
University of Notre Dame PhD
Zhihan Liu USC, 2022–2023
USC PhD
Victor Mylonas USC, 2021–2022
IMF

I have previously worked at the University of Chicago, University of Southern California, Boston University, and University of Oxford. I have also previously worked in the U.K. Government as an Economist, and had a short-term position as a Fellow at the Social and Behavioral Sciences Team at the Office of Science and Technology Policy, Office of the U.S. President.

I completed my Ph.D. at Imperial College London, M.Sc. at the London School of Economics, and B.A. at the University of Wales, Swansea. I grew up in a working class family and neighborhood in Swansea, United Kingdom, and am a first-generation college graduate.

I am also co-founder of two companies: The Behavioralist and Signol.