Revyzor Mini Study · August 2026
If you compress the model's working state, do the answers change? We ran the same 500-question legal benchmark battery across two model families, two model sizes, and two precision levels, with and without Revyzor. This note reports what we found, including the runs where a handful of answers differed, and why.
Every practical form of working-state compression in the AI ecosystem today is lossy: it changes the numbers the model computes with, and therefore can change the answers the model gives. For a chatbot that may be acceptable. For a system whose retained state is meant to serve as the record of what the model considered, it is not. The record must be the state, not an approximation of it.
Revyzor's lossless mode reconstructs the working state exactly, checked layer by layer at capture. But a byte-level check is an engineering claim. The question a buyer actually asks is behavioural:
Across hundreds of real questions, does the model with Revyzor in the path give the same answers as the model without it?
For regulated use, "almost always" is not an answer. So we measured it, repeatedly, across configurations chosen to stress the claim from different directions.
Each run uses five tasks from LegalBench, the standard legal reasoning benchmark: corporate lobbying classification, two supply-chain disclosure tasks, merger-agreement consideration typing (MAUD), and insurance policy interpretation. 100 questions per task, 500 per run, deterministic decoding, exact-match scoring against the published gold labels.
Every configuration is run twice: once as a plain baseline, once with Revyzor's lossless compression active on every layer of the working state for every question. Nothing else changes: same weights, same prompts, same engine version, same GPU class. Any difference between the two columns is therefore attributable to the compression path or to the serving engine's own run-to-run variation, and we distinguish the two below.
We tested across three axes:
| Configuration | Answers unchanged with Revyzor | Benchmark score (both arms) |
|---|---|---|
| Qwen2.5-7B, full precision, single-shot | 498–499 / 500 | ~371 / 500 |
| Gemma 4 31B, 4-bit quantised, single-shot | 499 / 500 | 384–385 / 500 |
| Gemma 4 31B, full precision, single-shot | 500 / 500 | 385 / 500 |
| Gemma 4 31B, multi-step reasoning (200 chained answers) | 199–200 / 200 | task-dependent |
"Answers unchanged" compares the raw generated answer, question by question, between the baseline arm and the Revyzor arm of the same run. Full-precision Gemma 4: all 500 raw answers identical, and identical scores on all five tasks, including 100/100 on MAUD in both arms.
Three configurations show one or two differing answers. We investigated each one rather than rounding them away:
The conclusion we draw, and invite others to test: the residual variation is serving-engine scheduling noise, not compression. Where conditions removed the near-ties (the full-precision 31B run), the variation went to zero.
Two trends run through the table, and both point the same way.
First, parity tightened as the model got bigger and more precise. The strongest configuration, the largest model at full precision, is the one where all 500 answers matched. This matters because it is exactly the configuration regulated deployments run: full-precision weights, nothing lossy anywhere in the stack. The compression ratio in that configuration was 1.45×, with per-layer handling in the 11–22 millisecond range, inline with serving.
Second, the hardest workload held. Multi-step chained reasoning is the stress case: the model's own intermediate outputs become inputs to later steps, so any perturbation has hundreds of opportunities to compound. Across 200 chained answers per run, the two arms matched 199–200 times, with one run matching perfectly on all 200. Retention held on precisely the workload, long recursive reasoning, that retention exists to serve.
Accuracy and assurance scaled together. The bigger and more precise the model, the higher the benchmark score, and the tighter the parity. There is no trade to manage.
A results note is only as credible as its stated limits. Ours are these:
Full methodology, per-task tables, raw answer files, and the rerun recipe are available under NDA.