case file 02 · scale
All case filesThe intervention: classifier guidance. What moved: the variance.
tailspec · the guided-generation audit
Enrichment by variance collapse
NVIDIA’s guided-generation method steers a generative weather emulator toward rare events and samples them 4 to 90 times faster. The audit measures what the guidance does to the distribution those samples come from.
the finding
More Events from a Narrower Distribution
Classifier guidance conditions the emulator’s sampler on the events of interest, so rare outcomes appear in the sample far more often than they would unguided. The reported enrichment factors of 4 to 90 are real, and they are the method’s pitch: tail statistics at a fraction of the compute.
The enriched samples do not come from the same tail. Pooled across events, the fitted generalised Pareto shape parameter of guided samples is −2.005, compared with −0.265 for unguided ones: a sharply truncated tail in place of a mildly bounded one. In other words, the guidance concentrates probability mass near its target rather than extending the model’s reach past it. That collapse of scale is what makes the extra events cheap.
The method’s own reliability diagnostic agrees: the estimator that turns guided samples back into event probabilities fails its own k gate on these runs, so the enriched sample does not yield a trustworthy exceedance estimate.
the technical version
Generalised Pareto fits to peaks-over-threshold exceedances, pooled across the audited events, guided versus unguided sampling of the same emulator. Estimator reliability follows the method’s own Pareto-k diagnostic, with the standard threshold as the gate.
4×–90×
enrichment of the target events under guidance
ξ −0.265 → −2.005
pooled GPD shape, unguided to guided
the deep dive
tailtwist, the audit in full
Sampler configurations, per-event fits and the reliability diagnostics, at tailtwist.wienkers.com. →
get in touch
The code behind this site is in a private repository for now. If any of it is useful to you, get in touch.