VX-One: Typed, Calibrated Decision Heads for Real-Time Perimeter Triage - An empirical study of unknown-attack honesty, cascade gray zones, and calibration under drift

Juan S. Santillana

Independent Researcher

Published October 21, 2026 · on the feed October 22, 2026 · ▲ 12 · arXiv 2610.30090

Safety, alignment & securityTheory & statistics Full code arXiv ↗Hugging Face ↗Weights ↗

The abstract

Perimeter triage faces a latency/semantics trade-off: signature engines are fast and format-safe but blind to unseen attacks, while generative models are semantic but slow and produce unparseable output. In late 2026 a class of commercial System One decision models (TypeSafe Jev; Microsoft-Decision-1) began selling typed decision primitives - binary gates, closed-set choices, ordinal scores - as product APIs, with no academic treatment. We present VX-One: a small multi-head network (100K-10M parameters) whose outputs are these primitives - a calibrated gate, a choice over a closed candidate set that always includes an explicit unknown option, and an ordinal score, trained multi-task, temperature-calibrated per head (~0.7-1.7 ms p50 on CPU). We evaluate it on UNSW-NB15, CIC-IDS2017, EMBER2024 against calibrated XGBoost, Random-Forest, MLP, Kitsune, and measure a two-phase cascade (Suricata with 52,674 Emerging-Threats rules -> VX-One) over five days of CIC-IDS2017. Findings: (i) VX-One wins detection (AUROC/FPR@95%TPR) on UNSW-NB15 and under temporal drift on CIC-IDS2017 (0.711 vs 0.637), but XGBoost wins multi-class attribution on all three benchmarks; (ii) leave-one-family-out gate detects never-seen families on 9/9 UNSW folds yet drops below chance on CIC recon family, and abstention threshold transfers poorly across benchmarks; (iii) on payload-less reconstructions signature engines resolve ~0.1% of flows - gray zone ~99.9% of traffic, recovered by Phase 2 (combined recall >=0.978); (iv) calibration collapses under temporal drift (ECE 0.04->0.40) for every method while ranking partially survives. We provide a measured account of where typed calibrated decisions help perimeter triage, and where they fail.

The Brief

3:25

A short podcast summary of the paper. Written and voiced by AI.

Transcript

VX-One. Typed, Calibrated Decision Heads for Real-Time Perimeter Triage - An empirical study of unknown-attack honesty, cascade gray zones, and calibration under drift. By Juan S. Santillana, working independently. Published on the twenty-first of October. Its code repository is worked out: about fifty source files, with a readme.

Perimeter triage, deciding quickly what to do with incoming network traffic, faces a trade between speed and meaning. Signature engines are fast and safe in their output format, but blind to attacks they have not seen. Generative models understand semantics, but they are slow and can produce output that cannot be parsed. In late two thousand twenty-six, the abstract notes, a class of commercial System One decision models, TypeSafe Jev and Microsoft-Decision-1, began selling typed decision primitives as product APIs: binary gates, closed-set choices and ordinal scores, with no academic treatment. VX-One is a small multi-head network, between one hundred thousand and ten million parameters, whose outputs are exactly those primitives. A calibrated gate. A choice over a closed set of candidates that always includes an explicit unknown option. And an ordinal score. It is trained multi-task and temperature-calibrated per head, running in roughly one to two milliseconds at the median on a CPU. The study's claim is a measured account of where such typed, calibrated decisions help perimeter triage, and where they fail.

The evaluation uses UNSW-NB15, CIC-IDS2017 and EMBER2024, against calibrated XGBoost, Random-Forest, MLP and Kitsune. On detection, VX-One wins on UNSW-NB15 and under temporal drift on CIC-IDS2017, with zero point seven one one against zero point six three seven. XGBoost, though, wins multi-class attribution on all three benchmarks.

For unknown attacks, a leave-one-family-out gate detects never-seen families on all nine UNSW folds, yet falls below chance on the CIC recon family, and the abstention threshold transfers poorly between benchmarks.

A two-phase cascade was also measured over five days of CIC-IDS2017: Suricata, with fifty-two thousand six hundred and seventy-four Emerging-Threats rules, followed by VX-One. On payload-less reconstructions the signature engine resolves about zero point one percent of flows. That leaves a gray zone of about ninety-nine point nine percent of traffic, which Phase two recovers, with combined recall of at least zero point nine seven eight. Finally, calibration collapses under temporal drift for every method, with expected calibration error rising from zero point zero four to zero point four, while ranking partially survives.

The study is bounded by its three benchmarks and its four baselines, and the cascade by five days of one dataset, using payload-less reconstructions. The results cut both ways by design. VX-One leads on detection, not attribution. Unknown-family detection works on one benchmark and fails on a family in another. And the calibration collapse under drift is not specific to VX-One: it hits every method tested, so calibration measured before drift should not be trusted after it.

What the paper offers is less a winner than a map. Typed, calibrated heads make the cascade practical, since the signature stage leaves almost all traffic unresolved. The honest unknown option generalizes unevenly, and no calibration in this study survives the passage of time.

More with an account

Listen to every day’s papers

Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.

Join free
KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.