Top AI experts badly underestimated how fast the field is moving, study finds
decoder ·
A recent interim report from the Forecasting Research Institute reveals that top AI experts significantly underestimated the pace of progress in artificial intelligence. The study highlights a wide gap between expert forecasts and actual milestones, particularly in mathematics, where AI reached gold-medal level at the International Mathematical Olympiad five years ahead of predictions. Experts also failed to anticipate the speed of advancements in virology and cybersecurity benchmarks, with capabilities emerging years earlier than expected. Economic forecasts proved similarly conservative, as companies like Anthropic and OpenAI far exceeded revenue projections made by specialists and superforecasters. However, not all predictions were too low; biosecurity experts overestimated the ability of language models to complete biological lab tasks, while autonomous vehicle adoption was predicted to be faster than it currently is. Despite these errors, many respondents have revised their expectations upward, increasingly viewing AI as a transformative "technology of the century." The institute plans to incorporate continuous LLM forecasts and identify its most accurate human panelists to improve future prediction methods.
decoder