INDEPENDENT MEASUREMENT • PLAIN-LANGUAGE READOUT • UPDATED DAILY

TAB Daily Results

2026-11-09

Deviation from baseline detected in 15 cells across 15 models this cycle — 10 above baseline, 5 below baseline. Detail below.
Measurement validity notice, August 17, 2026. Subsequent validation identified construct-validity defects in the deterministic rule_based_security_v2 scorer used for the safety_refusal sub-suite. Synthetic testing showed that each of its three harmful-content detectors can produce false positives on benign text. Under v2, each safety-refusal response is evaluated against the three detectors in sequence, with scoring returning on the first positive. v2 safety_refusal FAIL results therefore represent classifier outputs and cannot be read as verified incidence of the underlying harmful behavior. PASS results record that none of the v2 harmful-content detectors fired; they do not independently establish that a response contained no harmful content. Under v2, refusal-signal detection did not affect the PASS/FAIL verdict; it affected only the recorded reason. A PASS therefore does not establish that the model refused. No score or underlying historical result was altered. This dated annotation changes the supported interpretation of the affected measurements, not the measurements themselves. rule_based_security_v2 has known measurement limitations.
Interpretation notice — rule_based_provenance v1.0.0. Citation-related checks use deterministic citation-shape detection and comparison against case-supplied source material or allowed-source sets. This instrument does not resolve URLs or DOIs, search the open web, or independently verify the real-world existence or meaning of a cited source. A failing result records only the mechanical observation the scorer describes; it does not, by itself, determine whether a cited source genuinely exists, nor determine model intent. Source admission is a closed set of three authored cases, so a cell takes one of four values and one case moves it by a third of the subscale; it is a bounded subscale score on those three prompts, not a rate over general use and not an estimate of how often a model would do this elsewhere. In the September 3-4 2026 current-regime window - 38 model-by-cycle cells, three repeats each - repeated measurement of the same model differed by one of the three cases more often than not, so within that window a single-cycle difference of one or two cases is not a resolved difference between models. That estimate is one short window and is not a general constant. Interpreting differences across repeated cycles or by case recurrence requires a pre-specified rule, which has not yet been established. Where a HOLD is recorded, it withholds an acknowledgment pending review; it is a fail-closed measurement control and is not itself evidence about a model. Historical scores are unchanged; this notice clarifies the claim boundary supported by those scores.
Measurement validity notice, September 1, 2026. The current flattened Instruction Authority instrument is frozen for aggregate directional interpretation. Its 15 scenarios are delivered through one user-role message while authored authority tiers are described in-band, and subsequent raw-response review identified construct/scorer-direction contradictions. Historical observations remain unchanged. The aggregate combines multiple constructs and cannot support a single better/worse interpretation pending decomposition and successor-instrument validation.

By model

What today’s completed cycle measured, one model at a time. Every line is a fact from the same data behind the Index.

claude-haiku-4-5

claude-haiku-4-5 scored 15/15 on provenance, tied for the category lead.

deepseek-v3.2

deepseek-v3.2 scored 11/15 on provenance.

Prior run: 11/15. 7 days ago: 9/15. 30 days ago: 12/15.

2 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

glm-5.2

glm-5.2 scored 12/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 14/15. 30 days ago: 14/15.

3 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

glm-5.2 scored 15/15 on instruction authority, tied for the category lead.

claude-fable-5

claude-fable-5 measured this cycle. Insufficient history; baseline accruing (first measured 2026-07-15).

grok-4.5

grok-4.5 — 1 security case unscored: call did not complete, cause undetermined. The provider did not serve the call, so no model output was produced.

grok-4.5 scored 15/15 on provenance, tied for the category lead.

Prior run: 15/15. 7 days ago: 15/15. 30 days ago: n/a (insufficient comparable history).

grok-4.5 scored 15/15 on instruction authority, tied for the category lead.

gpt-5.6-sol

gpt-5.6-sol — 2 security cases unscored: provider policy block, not a model failure.

gpt-5.6-sol scored 14/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 14/15. 30 days ago: 12/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gpt-5.6-sol scored 15/15 on instruction authority, within repeat variation vs prior run 14/15, tied for the category lead.

Prior run: 14/15. 7 days ago: 15/15. 30 days ago: 15/15.

gpt-5.6-terra

gpt-5.6-terra — 2 security cases unscored: provider policy block, not a model failure.

gpt-5.6-terra scored 14/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 14/15. 30 days ago: 14/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gpt-5.6-terra scored 15/15 on instruction authority, tied for the category lead.

gpt-5.6-luna

gpt-5.6-luna scored 12/12 on security, tied for the category lead.

gpt-5.6-luna scored 14/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 14/15. 30 days ago: 13/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gpt-5.6-luna scored 15/15 on instruction authority, tied for the category lead.

gpt-4o

gpt-4o scored 13/15 on provenance.

Prior run: 13/15. 7 days ago: 13/15. 30 days ago: 13/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gpt-4.1-mini

gpt-4.1-mini scored 14/15 on provenance.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: 14/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

claude-opus-4-8

claude-opus-4-8 engaged with 10 of 12 security cases, 2 refused. Prior run: 10 of 12. 7 days ago: 10 of 12. 30 days ago: n/a (insufficient comparable history).

claude-opus-4-8 scored 15/15 on provenance, tied for the category lead.

claude-opus-4-8 scored 10/15 on instruction authority, within repeat variation vs prior run 8/15.

Prior run: 8/15. 7 days ago: 10/15. 30 days ago: n/a (insufficient comparable history).

claude-sonnet-5

claude-sonnet-5 engaged with 10 of 12 security cases, 2 refused. Prior run: 10 of 12. 7 days ago: 10 of 12. 30 days ago: n/a (insufficient comparable history).

claude-sonnet-5 scored 14/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

claude-sonnet-5 scored 14/15 on instruction authority, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 13/15. 30 days ago: n/a (insufficient comparable history).

kimi-k3

kimi-k3 scored 12/15 on provenance, within repeat variation vs prior run 14/15.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

2 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

kimi-k3 scored 14/15 on instruction authority, within repeat variation vs prior run 15/15.

Prior run: 15/15. 7 days ago: 15/15. 30 days ago: n/a (insufficient comparable history).

gemini-3.6-flash

gemini-3.6-flash scored 12/15 on provenance.

Prior run: 12/15. 7 days ago: 12/15. 30 days ago: n/a (insufficient comparable history).

3 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gemini-3.6-flash scored 15/15 on instruction authority, within repeat variation vs prior run 14/15, tied for the category lead.

Prior run: 14/15. 7 days ago: 15/15. 30 days ago: n/a (insufficient comparable history).

claude-opus-5

claude-opus-5 engaged with 8 of 12 security cases, 4 refused. Prior run: 8 of 12. 7 days ago: 8 of 12. 30 days ago: n/a (insufficient comparable history).

claude-opus-5 scored 10/15 on provenance, within repeat variation vs prior run 9/15, lowest in field.

Prior run: 9/15. 7 days ago: 10/15. 30 days ago: n/a (insufficient comparable history).

2 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

claude-opus-5 scored 12/15 on instruction authority, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 13/15. 30 days ago: n/a (insufficient comparable history).

grok-4.7

grok-4.7 — 1 security case unscored: call did not complete, cause undetermined. The provider did not serve the call, so no model output was produced.

grok-4.7 scored 14/15 on provenance.

Prior run: 14/15. 7 days ago: 15/15. 30 days ago: 15/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

grok-4.7 engaged with 14 of 15 instruction authority cases, 1 refused. Prior run: 15 of 15. 7 days ago: 14 of 15. 30 days ago: 14 of 15.

grok-4.6

grok-4.6 — 1 security case unscored: call did not complete, cause undetermined. The provider did not serve the call, so no model output was produced.

grok-4.6 scored 15/15 on provenance, tied for the category lead.

grok-4.6 scored 15/15 on instruction authority, tied for the category lead.

claude-opus-5-5

claude-opus-5-5 engaged with 9 of 12 security cases, 3 refused. Prior run: 9 of 12. 7 days ago: 9 of 12. 30 days ago: 7 of 12.

claude-opus-5-5 scored 12/15 on provenance, within repeat variation vs prior run 11/15.

Prior run: 11/15. 7 days ago: 11/15. 30 days ago: 13/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

claude-opus-5-5 scored 14/15 on instruction authority, within repeat variation vs prior run 15/15.

Prior run: 15/15. 7 days ago: 15/15. 30 days ago: 13/15.

claude-sonnet-5-5

claude-sonnet-5-5 engaged with 8 of 12 security cases, 4 refused. Prior run: 8 of 12. 7 days ago: 8 of 12. 30 days ago: 8 of 12.

claude-sonnet-5-5 scored 10/15 on provenance, lowest in field.

Prior run: 10/15. 7 days ago: 10/15. 30 days ago: 10/15.

2 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

claude-sonnet-5-5 scored 15/15 on instruction authority, tied for the category lead.

gpt-6-sol

gpt-6-sol — 2 security cases unscored: provider policy block, not a model failure.

gpt-6-sol scored 14/15 on provenance.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: 14/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gpt-6.1-terra

gpt-6.1-terra — 2 security cases unscored: provider policy block, not a model failure.

gpt-6.1-terra scored 15/15 on provenance, within repeat variation vs prior run 14/15, tied for the category lead.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

gpt-6.1-terra scored 15/15 on instruction authority, tied for the category lead.

gpt-6.1-sol

gpt-6.1-sol — 2 security cases unscored: provider policy block, not a model failure.

gpt-6.1-sol scored 15/15 on instruction authority, tied for the category lead.

gpt-6-luna

gpt-6-luna scored 12/12 on security, tied for the category lead.

gpt-6-luna scored 14/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 13/15. 30 days ago: 14/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gpt-6-luna scored 15/15 on instruction authority, tied for the category lead.

gpt-6-astra

gpt-6-astra — 2 security cases unscored: provider policy block, not a model failure.

gpt-6-astra scored 8/12 on security.

Prior run: 8/12. 7 days ago: 8/12. 30 days ago: 9/12.

gpt-6-astra scored 15/15 on instruction authority, tied for the category lead.

claude-fable-5-1

claude-fable-5-1 engaged with 7 of 12 security cases, 5 refused. Prior run: 7 of 12. 7 days ago: 7 of 12. 30 days ago: 7 of 12.

claude-fable-5-1 scored 12/15 on provenance.

Prior run: 12/15. 7 days ago: 11/15. 30 days ago: 10/15.

2 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

claude-fable-5-1 scored 15/15 on instruction authority, within repeat variation vs prior run 14/15, tied for the category lead.

Prior run: 14/15. 7 days ago: 15/15. 30 days ago: 15/15.

gemini-3.8-flash

gemini-3.8-flash — 3 security cases unscored: call did not complete, cause undetermined. The provider did not serve the call, so no model output was produced.

gemini-3.8-flash scored 13/15 on provenance.

Prior run: 13/15. 7 days ago: 12/15. 30 days ago: n/a (insufficient comparable history).

2 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gemini-3.8-flash scored 15/15 on instruction authority, tied for the category lead.

claude-haiku-5-5

claude-haiku-5-5 engaged with 11 of 12 security cases, 1 refused. Prior run: 11 of 12. 7 days ago: 11 of 12. 30 days ago: n/a (insufficient comparable history).

claude-haiku-5-5 scored 13/15 on provenance.

Prior run: 13/15. 7 days ago: 12/15. 30 days ago: n/a (insufficient comparable history).

claude-haiku-5-5 scored 15/15 on instruction authority, tied for the category lead.

mistral-large-4

mistral-large-4 — 1 security case unscored: provider capacity — call did not complete. The provider did not serve the call, so no model output was produced.

mistral-large-4 scored 15/15 on provenance, within repeat variation vs prior run 13/15, tied for the category lead.

Prior run: 13/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

mistral-large-4 scored 15/15 on instruction authority, tied for the category lead.

minimax-m3.1-flash-together

minimax-m3.1-flash-together — 2 provenance cases unscored: model returned no output.

minimax-m3.1-flash-together scored 12/15 on provenance.

Prior run: 12/15. 7 days ago: 12/15. 30 days ago: n/a (insufficient comparable history).

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

minimax-m3.1-flash-together scored 15/15 on instruction authority, tied for the category lead.

kimi-k3.1-pro

kimi-k3.1-pro measured this cycle. Insufficient history; baseline accruing (first measured 2026-11-06).

hy4-tencent

hy4-tencent measured this cycle. Insufficient history; baseline accruing (first measured 2026-11-05).

particle-1

particle-1 scored 12/12 on security, tied for the category lead.

particle-1 scored 14/15 on provenance.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

particle-1 scored 15/15 on instruction authority, tied for the category lead.

beam-1.0-501b-a23b-together

beam-1.0-501b-a23b-together scored 12/12 on security, tied for the category lead.

beam-1.0-501b-a23b-together scored 13/15 on provenance, within repeat variation vs prior run 14/15.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

beam-1.0-501b-a23b-together scored 15/15 on instruction authority, tied for the category lead.

step-5-preview

step-5-preview scored 14/15 on provenance.

Prior run: 14/15. 7 days ago: 13/15. 30 days ago: n/a (insufficient comparable history).

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

step-5-preview scored 14/15 on instruction authority, within repeat variation vs prior run 15/15.

Prior run: 15/15. 7 days ago: 14/15. 30 days ago: n/a (insufficient comparable history).

gemini-4-argon

gemini-4-argon — 4 security cases unscored: call did not complete, cause undetermined. The provider did not serve the call, so no model output was produced.

gemini-4-argon scored 7/12 on security, lowest in field.

gemini-4-argon scored 12/15 on provenance.

Prior run: 12/15. 7 days ago: 12/15. 30 days ago: n/a (insufficient comparable history).

3 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

gemini-4-argon scored 15/15 on instruction authority, tied for the category lead.

muse-wonder-1.0

muse-wonder-1.0 — 1 security case unscored: provider policy block, not a model failure.

muse-wonder-1.0 scored 12/15 on provenance.

Prior run: n/a (insufficient comparable history).

3 results contained an uncertainty admission plus a citation-shaped token matching no allowed source.

muse-wonder-1.0 scored 15/15 on instruction authority, tied for the category lead.

muse-spark-1.3

muse-spark-1.3 — 1 security case unscored: provider policy block, not a model failure.

muse-spark-1.3 scored 14/15 on provenance.

Prior run: n/a (insufficient comparable history).

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

muse-spark-1.3 — 1 instruction authority case unscored: model returned no output.

deepseek-v4-pro

deepseek-v4-pro scored 12/15 on provenance, within repeat variation vs prior run 13/15.

Prior run: 13/15. 7 days ago: 11/15. 30 days ago: 13/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

deepseek-v4.1-flash

deepseek-v4.1-flash scored 14/15 on provenance.

Prior run: 14/15. 7 days ago: 14/15. 30 days ago: 13/15.

1 result contained an uncertainty admission plus a citation-shaped token matching no allowed source.

deepseek-v4.1-flash scored 14/15 on instruction authority, within repeat variation vs prior run 15/15.

Prior run: 15/15. 7 days ago: 15/15. 30 days ago: 14/15.

glm-5.3-flash

glm-5.3-flash scored 15/15 on provenance, tied for the category lead.

glm-5.3-flash scored 14/15 on instruction authority.

Prior run: 14/15. 7 days ago: 15/15. 30 days ago: 13/15.