Investor's Last Exam: Can AI Agents Do Equity Investment Without Seeing the Future?
Huangfei Jiang, Anning Hu, Kai Sheng, Yuchen Cai, Rui Ge, Xiangyu Kong, Jianghao Lin, Shuzi Chen and 2 others
Prophetlab · RethinkLab · Antai College of Economics and Management, SJTU · USTC · Foresight Fund · IvyRock Asset Management
Published October 28, 2026 · on the feed October 30, 2026 · ▲ 14 · arXiv 2610.38342
The abstract
Financial agents must form forecasts and investment judgments from decision-time evidence, with predictions evaluated against subsequent outcomes. Existing benchmarks assess financial knowledge, research workflows, or forecasting, but evaluating the full research process requires a strictly frozen information set and professional evaluation criteria. We introduce Investor's Last Exam (ILE), an equity-research benchmark led by experienced buy-side investors and fund managers. Its three components are a versioned financial database spanning 3.43 million document versions and nine source categories, supplemented by structured market data, with validated timestamps governing retrieval and computation; a task taxonomy organized around professional analyst deliverables; and an expert-led framework linking scoring criteria to sources, calculations, and assumptions through financial dependency graphs. Evaluation spans 86 assignments and jointly assesses research quality, forecast accuracy, and simulated investment performance. GPT-6 Astra and Claude Opus 5.5 lead overall at 68.1 and 66.9 out of 100, yet even Astra scores only 52.5 on Forecast & Model. Our results show that even state-of-the-art models fail to translate overall research capability into predictive performance. ILE shifts the evaluation unit from isolated capabilities to the evidence--assumption--judgment chain, allowing researchers to locate where analytical advantages fail to translate into forecasts and investment judgments, and providing a traceable, diagnostic foundation for training and evaluating financial agents.
The Brief
2:31A short podcast summary of the paper. Written and voiced by AI.
Transcript
Investor's Last Exam. Can AI Agents Do Equity Investment Without Seeing the Future?. By Huangfei Jiang and nine others, from Prophetlab, RethinkLab, and four other institutions. Published on the twenty-eighth of October.
A financial agent has to form forecasts and investment judgments from the evidence available at the moment of decision, and those predictions are then judged against what actually happened next. Existing benchmarks assess parts of this: financial knowledge, research workflows, or forecasting. Evaluating the whole research process asks for two things together. A strictly frozen information set, so the agent cannot see the future. And professional criteria for what good research looks like.
Investor's Last Exam, or ILE, is an equity-research benchmark led by experienced buy-side investors and fund managers. Its evaluation spans eighty-six assignments and assesses three things jointly: the quality of the research, the accuracy of the forecasts, and simulated investment performance. Assessing them jointly is the point: it is the full research process that is being evaluated, from the evidence an analyst gathers to the judgment they finally make, rather than one skill at a time.
It has three components. The first is a versioned financial database spanning three point four three million document versions across nine source categories, supplemented by structured market data. Validated timestamps govern both retrieval and computation, which is how the information set stays frozen at decision time.
The second is a task taxonomy organized around the deliverables a professional analyst actually produces. The third is an expert-led scoring framework. It links each scoring criterion back to sources, calculations and assumptions through financial dependency graphs.
GPT-6 Astra and Claude Opus 5.5 lead overall, at sixty-eight point one and sixty-six point nine out of one hundred. Yet even Astra scores only fifty-two point five on Forecast and Model. The authors read this as evidence that even state-of-the-art models fail to translate overall research capability into predictive performance.
Put plainly, leading overall does not carry over into predicting well. The distance between Astra's overall score and its much lower score on Forecast and Model is where that shows, inside a single model. And because the information set is frozen at decision time, those forecasts are checked against outcomes the model could not have seen.
The shift ILE makes is in the unit being evaluated. Instead of testing isolated capabilities, it follows the chain from evidence to assumption to judgment. That is what lets a researcher locate where an analytical advantage stops carrying through into forecasts and investment decisions, and it gives a traceable, diagnostic base for training and evaluating financial agents.
More with an account
Listen to every day’s papers
Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.
Join free