Back to dashboard·

AI vs Analysts — relative benchmark

Not a who-was-right contest: systematic bias, the value of combining both, and how it splits by market regime.
1401 forecast windows2026-03-17 – 2026-06-09engine v6+v7
Disagreement mapBenchmark
AllOMXHS&P
30 d60 d90 d

Does AI add information on top of analysts?

A combined forecast weighting the AI panel at 25% and analysts at 75% was less wrong than either alone: mean absolute error 12.6% vs analysts 14.1% and AI 24.6%.
Out-of-sample check: blend weight fitted on data up to 2026-05-05, then evaluated on the 575 later observations — blend 12.6% vs analysts 14.3%.
Error as a function of the blend weight
Each point = mean absolute error when the forecast mixes AI and analysts at that weight. The dip between the endpoints is the whole story: the blend beats both.
15%20%25%100% analysts100% AIw*=0.25
optimal weight (in-sample)out-of-sample check
AI panel bias
-8.5%
Mean forecast error of the AI panel median (before any analyst anchoring) vs the realized price. Negative = systematically conservative.
Analyst bias
+8.8%
Mean forecast error of the analyst consensus target. Positive = systematically optimistic — consistent with the documented analyst-optimism effect.

Scorecard · n=1401 · 2026-03-17–2026-06-09

AI panelAnalystsBlend (25% AI)
Mean absolute error
24.6%
14.1%
12.6%
Directional accuracy
52.2%
56.6%
60.2%
Systematic bias-8.5%+8.8%—

Forecast error over time

Daily mean forecast error (estimate vs realized price at the horizon). 0% = unbiased.
-10%0%+10%v717.3.31.3.14.4.28.4.12.5.26.5.9.6.
AI panelAnalysts

By market regime

nAI biasAnalyst biasAI MAEAnalyst MAE
Up-market windows711-9.7%+7.0%25.3%13.9%
Down-market windows690-7.2%+10.7%24.0%14.3%
Regime = sign of the median realized return across tracked companies in each forecast window (derived from our own data, no external index).
Read this before quoting the numbers
  • The AI series is the pre-blend panel median — the models' own view before any analyst anchoring. The site's headline consensus is a calibrated blend and is deliberately not scored here.
  • Measurement window: engine v6+v7 only. The current engine v8 has 530 forecasts pending — its first windows mature 2026-07-10, and results will fold in as they do.
  • The optimal blend weight is fitted in-sample; the out-of-sample line above is the honest check. Treat both as indicative — the sample is a few months, not years.
  • Analyst targets come from Yahoo Finance and update with a lag, which flatters analyst responsiveness slightly.
  • Forecasts are 12-month targets scored at a 30-day horizon — this measures direction and calibration, not whether the 12-month target ends up exact.
Want these insights weekly?
Subscribe to AI Signals →
All content is generated by AI models and may contain errors. This is an experimental tool — not investment advice, research, or recommendation. Terms of Use · Privacy Policy