Bent Flyvbjerg and Dirk Bester have developed new methods and data to overcome this.
Research from Bent Flyvbjerg, Emeritus BT Professor Major Programme Management at Saïd Business School, and Dirk W. Bester, professional statistician, finds that cost-benefit analyses of public investments are highly inaccurate and biased.
The bad news is this means the many cost-benefit analyses underpinning most public investments -- from HS2 in the UK to California's high-speed rail line -- cannot be trusted as currently done. The good news is that Flyvbjerg and Bester have developed better methods and data to overcome this.
Professor Flyvbjerg found that amongst forecasters, policymakers and scholars there tends to be a misguided assumption that cost-benefit forecasts are more or less accurate, when in fact they are highly inaccurate and biased. This fallacy, called the "cost-benefit fallacy" results in overestimates of benefit-cost ratios of 50 to 200 per cent, with individual estimates often exceeding these averages. The fallacy makes investments look profitable on paper, when in reality they are often unprofitable.
The cost-benefit fallacy is shown to be fundamental and pervasive, which has never been documented before.
2,062 public capital investments were considered during the study, these consisted of dams, rail developments, tunnels and bridges amongst other major infrastructure projects. The sample included investments from 104 countries dating between 1927 and 2018, the older investments allowing historical trends to be considered.
Professor Flyvbjerg recommends that to redress these cost-benefit failings the following method should be followed:
- Behavioural science should be used to address biases in cost-benefit analysis
- Incentives should be used to encourage this
- Independent audits should be used to verify results
- Other real-life concerns that need consideration alongside cost-benefit analysis should be integrated through normal democratic processes
Professor Flyvbjerg commented: ‘The findings are crucial for all policymaking based on cost-benefit analysis. Policymakers will make the wrong decisions if they trust cost-benefit analysis as it is practiced today. We don't stop with pointing out the problem, however, we also present solutions. This research used an incredibly large dataset, the biggest of its kind in the world. But precisely because of the many data our conclusions are firm: the cost-benefit fallacy is a fact that must be overcome if good policymaking is the goal.’