mirror of
https://github.com/profullstack/logicsrc.git
synced 2026-10-01 20:33:50 +00:00
docs: OpenStream benchmark reports, published per release (#150)
Adds a reports section to the OpenStream spec so its claims rest on a reproducible measurement rather than an assertion. Each report is a run of the envelope over a defined corpus on real hardware: proof that decompression restores every byte, that an incompressible input costs only the framing overhead, that a compressible one saves what it claims against the complete wire size, and how long each codec takes. - docs/openstream/reports/ holds a machine-readable <id>.json (canonical, with a versioned schema) and a rendered <id>.md per report, plus a README on the shape and on submitting one. The seed report is nixamp 0.17.1 over the synthetic corpus, labelled synthetic so no one reads a padded-fixture number as production. - The site renders them at /docs/openstream/reports (index) and /docs/openstream/reports/<id> (one report), under the dynamic /docs/[slug] tree so the reports routes never shadow a spec's own doc page. A small lib/reports.ts reads the JSON at build time; REPORTED_SPECS keeps the route surface explicit. sitemap includes the index and every report. - The spec doc gains a Benchmark reports section linking there, and repeats the honest caveats: OpenStream frames Zstandard and gzip rather than being a new algorithm, synthetic padding flatters a codec, an efficient real feed saves little, and round-trip exactness is the one pass/fail. The report format is produced by `nixamp compression benchmark` (in the nixamp repo); a release runs it and commits the two files here. Claude-Session: https://claude.ai/code/session_01MxNif5tsYq4LczgG7aE8Jp Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
GitHub
parent
692bfa0a2a
commit
9f42ce222a
8 changed files with 1145 additions and 1 deletions
793
docs/openstream/reports/2026-09-12-nixamp-0.17.1-synthetic.json
Normal file
793
docs/openstream/reports/2026-09-12-nixamp-0.17.1-synthetic.json
Normal file
|
|
@ -0,0 +1,793 @@
|
|||
{
|
||||
"schema": 1,
|
||||
"spec": "openstream",
|
||||
"specVersion": "NXS1",
|
||||
"generatedAt": "2026-09-12T13:13:15.713Z",
|
||||
"implementation": {
|
||||
"name": "nixamp",
|
||||
"version": "0.17.1"
|
||||
},
|
||||
"environment": {
|
||||
"runtime": "bun 1.4.0",
|
||||
"zstd": "f8745da6ff1ad1e7bab384bd1f9d742439278e99",
|
||||
"zlib": "12731092979c6d07f42da27da673a9f6c7b13586",
|
||||
"os": "linux 7.0.0-30-generic",
|
||||
"arch": "x64",
|
||||
"cpu": "DO-Premium-Intel",
|
||||
"cores": 8,
|
||||
"memoryGiB": 15.6
|
||||
},
|
||||
"envelope": {
|
||||
"magic": "NXS1",
|
||||
"streamHeaderBytes": 16,
|
||||
"frameHeaderBytes": 48
|
||||
},
|
||||
"policy": {
|
||||
"minSavingsPercent": 3,
|
||||
"minSavingsBytes": 512,
|
||||
"maxBlockBytes": 262144,
|
||||
"zstdLevels": [
|
||||
1,
|
||||
3,
|
||||
9
|
||||
]
|
||||
},
|
||||
"samples": [
|
||||
{
|
||||
"sample": "random-1mib",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 1048576,
|
||||
"sha256": "562a223dca6ae12049e4e88ded6b6c0c7d18f29d5b941309fcd1f5cc19bc15b0",
|
||||
"container": "bytes",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 51.89,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 7.69,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 6.04,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 8.08,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 1,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 99.99,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": false,
|
||||
"note": "not a transport stream: ts-zstd does not apply"
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"reason": "no codec beat stored by the configured margin"
|
||||
}
|
||||
},
|
||||
{
|
||||
"sample": "zeros-1mib",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 1048576,
|
||||
"sha256": "30e14955ebf1352266dc2ff8067e68104607e750abb9d3b36582b8af909fcb58",
|
||||
"container": "bytes",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1156,
|
||||
"wireBytes": 1412,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.87,
|
||||
"encodeMs": 2.14,
|
||||
"decodeMs": 5.25,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 116,
|
||||
"wireBytes": 372,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.96,
|
||||
"encodeMs": 2.1,
|
||||
"decodeMs": 6.9,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 116,
|
||||
"wireBytes": 372,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.96,
|
||||
"encodeMs": 2.38,
|
||||
"decodeMs": 4.25,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 112,
|
||||
"wireBytes": 368,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.96,
|
||||
"encodeMs": 7.79,
|
||||
"decodeMs": 5.76,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 1,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 99.99,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": false,
|
||||
"note": "not a transport stream: ts-zstd does not apply"
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"reason": "saves 99.96% of the complete wire size"
|
||||
}
|
||||
},
|
||||
{
|
||||
"sample": "text-repeat-1mib",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 1048576,
|
||||
"sha256": "d05bf128d112bfd591628a68880676f643191beeb91d1250ce8c98212bf6e464",
|
||||
"container": "bytes",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 1048576,
|
||||
"wireBytes": 1048832,
|
||||
"storedBlocks": 4,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.02,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 6946,
|
||||
"wireBytes": 7202,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.31,
|
||||
"encodeMs": 2.02,
|
||||
"decodeMs": 4.48,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 324,
|
||||
"wireBytes": 580,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.94,
|
||||
"encodeMs": 1.62,
|
||||
"decodeMs": 12.04,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 318,
|
||||
"wireBytes": 574,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.95,
|
||||
"encodeMs": 1.82,
|
||||
"decodeMs": 3.89,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 4,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 316,
|
||||
"wireBytes": 572,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 4,
|
||||
"savingsPercent": 99.95,
|
||||
"encodeMs": 2.78,
|
||||
"decodeMs": 3.18,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 1,
|
||||
"inputBytes": 1048576,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 99.99,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": false,
|
||||
"note": "not a transport stream: ts-zstd does not apply"
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"reason": "saves 99.95% of the complete wire size"
|
||||
}
|
||||
},
|
||||
{
|
||||
"sample": "ts-padded-50pct",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 752000,
|
||||
"sha256": "fbbe8a14abcd5d36e40ccf8d5d80eca805580cccd632842a4f1cea9461863a6d",
|
||||
"container": "mpegts",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 379358,
|
||||
"wireBytes": 379566,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 3,
|
||||
"savingsPercent": 49.53,
|
||||
"encodeMs": 13.4,
|
||||
"decodeMs": 4.05,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 377821,
|
||||
"wireBytes": 378029,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 3,
|
||||
"savingsPercent": 49.73,
|
||||
"encodeMs": 3.59,
|
||||
"decodeMs": 4.18,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 375595,
|
||||
"wireBytes": 375803,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 3,
|
||||
"savingsPercent": 50.03,
|
||||
"encodeMs": 5.7,
|
||||
"decodeMs": 3.53,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 375109,
|
||||
"wireBytes": 375317,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 3,
|
||||
"savingsPercent": 50.09,
|
||||
"encodeMs": 17.19,
|
||||
"decodeMs": 4.56,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 375481,
|
||||
"wireBytes": 375689,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 3,
|
||||
"savingsPercent": 50.04,
|
||||
"encodeMs": 9.3,
|
||||
"decodeMs": 9.8,
|
||||
"roundTrip": true
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"reason": "saves 50.09% of the complete wire size"
|
||||
}
|
||||
},
|
||||
{
|
||||
"sample": "ts-unpadded",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 752000,
|
||||
"sha256": "675352f64a65d9ec2c3d7b69f11bb253cd882c3fcea85dd4a994675b5767c2c5",
|
||||
"container": "mpegts",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 26.52,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 3.62,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 8.11,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 17.49,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 3,
|
||||
"inputBytes": 752000,
|
||||
"payloadBytes": 752000,
|
||||
"wireBytes": 752208,
|
||||
"storedBlocks": 3,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -0.03,
|
||||
"encodeMs": 6.1,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"reason": "no codec beat stored by the configured margin"
|
||||
}
|
||||
},
|
||||
{
|
||||
"sample": "tiny-3b",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 3,
|
||||
"sha256": "ba7816bf8f01cfea414140de5dae2223b00361a396177a9cb410ff61f20015ad",
|
||||
"container": "bytes",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 1,
|
||||
"inputBytes": 3,
|
||||
"payloadBytes": 3,
|
||||
"wireBytes": 115,
|
||||
"storedBlocks": 1,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -3733.33,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 1,
|
||||
"inputBytes": 3,
|
||||
"payloadBytes": 3,
|
||||
"wireBytes": 115,
|
||||
"storedBlocks": 1,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -3733.33,
|
||||
"encodeMs": 0.37,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 1,
|
||||
"inputBytes": 3,
|
||||
"payloadBytes": 3,
|
||||
"wireBytes": 115,
|
||||
"storedBlocks": 1,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -3733.33,
|
||||
"encodeMs": 0.22,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 1,
|
||||
"inputBytes": 3,
|
||||
"payloadBytes": 3,
|
||||
"wireBytes": 115,
|
||||
"storedBlocks": 1,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -3733.33,
|
||||
"encodeMs": 0.18,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 1,
|
||||
"inputBytes": 3,
|
||||
"payloadBytes": 3,
|
||||
"wireBytes": 115,
|
||||
"storedBlocks": 1,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -3733.33,
|
||||
"encodeMs": 0.18,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 1,
|
||||
"inputBytes": 3,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": -2033.33,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": false,
|
||||
"note": "not a transport stream: ts-zstd does not apply"
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"reason": "no codec beat stored by the configured margin"
|
||||
}
|
||||
},
|
||||
{
|
||||
"sample": "empty",
|
||||
"kind": "synthetic",
|
||||
"inputBytes": 0,
|
||||
"sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"container": "bytes",
|
||||
"rows": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"blocks": 0,
|
||||
"inputBytes": 0,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 0,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"blocks": 0,
|
||||
"inputBytes": 0,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 0,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"blocks": 0,
|
||||
"inputBytes": 0,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 0,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"blocks": 0,
|
||||
"inputBytes": 0,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 0,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"blocks": 0,
|
||||
"inputBytes": 0,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 0,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"blocks": 0,
|
||||
"inputBytes": 0,
|
||||
"payloadBytes": 0,
|
||||
"wireBytes": 64,
|
||||
"storedBlocks": 0,
|
||||
"compressedBlocks": 0,
|
||||
"savingsPercent": 0,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0,
|
||||
"roundTrip": true
|
||||
}
|
||||
],
|
||||
"recommendation": {
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"reason": "no codec beat stored by the configured margin"
|
||||
}
|
||||
}
|
||||
],
|
||||
"summary": {
|
||||
"corpusBytes": 4649731,
|
||||
"byMode": [
|
||||
{
|
||||
"mode": "stored",
|
||||
"level": 0,
|
||||
"wireBytes": 4651091,
|
||||
"savingsPercent": -0.03,
|
||||
"roundTrip": true,
|
||||
"encodeMs": 0,
|
||||
"decodeMs": 0
|
||||
},
|
||||
{
|
||||
"mode": "gzip",
|
||||
"level": 6,
|
||||
"wireBytes": 2189399,
|
||||
"savingsPercent": 52.91,
|
||||
"roundTrip": true,
|
||||
"encodeMs": 96.34,
|
||||
"decodeMs": 13.78
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 1,
|
||||
"wireBytes": 2180200,
|
||||
"savingsPercent": 53.11,
|
||||
"roundTrip": true,
|
||||
"encodeMs": 18.84,
|
||||
"decodeMs": 23.12
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 3,
|
||||
"wireBytes": 2177968,
|
||||
"savingsPercent": 53.16,
|
||||
"roundTrip": true,
|
||||
"encodeMs": 24.23,
|
||||
"decodeMs": 11.67
|
||||
},
|
||||
{
|
||||
"mode": "zstd",
|
||||
"level": 9,
|
||||
"wireBytes": 2177476,
|
||||
"savingsPercent": 53.17,
|
||||
"roundTrip": true,
|
||||
"encodeMs": 53.51,
|
||||
"decodeMs": 13.5
|
||||
},
|
||||
{
|
||||
"mode": "ts-zstd",
|
||||
"level": 1,
|
||||
"wireBytes": 1127961,
|
||||
"savingsPercent": 25,
|
||||
"roundTrip": true,
|
||||
"encodeMs": 15.4,
|
||||
"decodeMs": 9.8
|
||||
}
|
||||
]
|
||||
},
|
||||
"caveats": [
|
||||
"Envelope v1: a 16-byte stream header, a 48-byte header per frame, plus one end frame.",
|
||||
"OpenStream is a framing envelope over Zstandard and gzip, not a new compression algorithm; these numbers are those codecs at the block boundary, honestly framed.",
|
||||
"Synthetic samples do not predict production savings. A padded transport stream flatters a codec by its padding; an efficient real feed saves far less. Use --corpus with authorized real samples for numbers that mean something.",
|
||||
"Timings are wall-clock on the machine and runtime named in `environment` and do not transfer to other hardware.",
|
||||
"roundTrip:false in any row is a failure of exactness and must block a release."
|
||||
]
|
||||
}
|
||||
|
|
@ -0,0 +1,38 @@
|
|||
# OpenStream benchmark — nixamp 0.17.1
|
||||
|
||||
Generated 2026-09-12T13:13:15.713Z · envelope NXS1 · schema 1
|
||||
|
||||
**Environment.** bun 1.4.0, zstd f8745da6ff1ad1e7bab384bd1f9d742439278e99, zlib 12731092979c6d07f42da27da673a9f6c7b13586, on linux 7.0.0-30-generic x64, 8× DO-Premium-Intel, 15.6 GiB.
|
||||
|
||||
**Policy.** block 262144 B; eligible at 3% and 512 B; zstd levels 1, 3, 9.
|
||||
|
||||
## Corpus
|
||||
|
||||
| sample | kind | bytes | container | best mode | saves |
|
||||
| --- | --- | ---: | --- | --- | ---: |
|
||||
| random-1mib | synthetic | 1048576 | bytes | stored | stored |
|
||||
| zeros-1mib | synthetic | 1048576 | bytes | zstd L9 | 99.96% |
|
||||
| text-repeat-1mib | synthetic | 1048576 | bytes | zstd L9 | 99.95% |
|
||||
| ts-padded-50pct | synthetic | 752000 | mpegts | zstd L9 | 50.09% |
|
||||
| ts-unpadded | synthetic | 752000 | mpegts | stored | stored |
|
||||
| tiny-3b | synthetic | 3 | bytes | stored | stored |
|
||||
| empty | synthetic | 0 | bytes | stored | stored |
|
||||
|
||||
## Aggregate, per mode across the corpus
|
||||
|
||||
| mode | wire bytes | saving | enc ms | dec ms | round trip |
|
||||
| --- | ---: | ---: | ---: | ---: | --- |
|
||||
| stored | 4651091 | -0.03% | 0 | 0 | ok |
|
||||
| gzip L6 | 2189399 | +52.91% | 96.34 | 13.78 | ok |
|
||||
| zstd L1 | 2180200 | +53.11% | 18.84 | 23.12 | ok |
|
||||
| zstd L3 | 2177968 | +53.16% | 24.23 | 11.67 | ok |
|
||||
| zstd L9 | 2177476 | +53.17% | 53.51 | 13.5 | ok |
|
||||
| ts-zstd L1 | 1127961 | +25% | 15.4 | 9.8 | ok |
|
||||
|
||||
## Caveats
|
||||
|
||||
- Envelope v1: a 16-byte stream header, a 48-byte header per frame, plus one end frame.
|
||||
- OpenStream is a framing envelope over Zstandard and gzip, not a new compression algorithm; these numbers are those codecs at the block boundary, honestly framed.
|
||||
- Synthetic samples do not predict production savings. A padded transport stream flatters a codec by its padding; an efficient real feed saves far less. Use --corpus with authorized real samples for numbers that mean something.
|
||||
- Timings are wall-clock on the machine and runtime named in `environment` and do not transfer to other hardware.
|
||||
- roundTrip:false in any row is a failure of exactness and must block a release.
|
||||
26
docs/openstream/reports/README.md
Normal file
26
docs/openstream/reports/README.md
Normal file
|
|
@ -0,0 +1,26 @@
|
|||
# OpenStream benchmark reports
|
||||
|
||||
Each file here is a reproducible run of the [OpenStream](../../openstream.md) benchmark: proof, on real hardware with recorded versions, that the envelope restores every byte, that an incompressible input costs only the framing overhead, that a compressible one saves what it claims against the complete wire size, and how long each codec takes. The site renders them at `/docs/openstream/reports`.
|
||||
|
||||
A report is two files sharing one id:
|
||||
|
||||
- `<id>.json` — the machine-readable report (canonical). Its `schema` field is the version of the shape below.
|
||||
- `<id>.md` — the same run rendered for reading, shown on the site.
|
||||
|
||||
The id is `YYYY-MM-DD-<implementation>-<version>[-<corpus>]`, for example `2026-09-12-nixamp-0.17.1-synthetic`. Append the corpus label when the run used the built-in synthetic corpus rather than authorized real samples, so no one mistakes a padded-fixture number for a production one.
|
||||
|
||||
## Publishing one
|
||||
|
||||
The reference implementation emits both files:
|
||||
|
||||
```
|
||||
nixamp compression benchmark --out .
|
||||
```
|
||||
|
||||
writes `openstream-report.json` and `openstream-report.md`. Rename them to the id, drop them in this directory, and open a pull request. The command exits non-zero if any codec that applied failed to restore byte-for-byte, so a report that would not build is caught before it is committed.
|
||||
|
||||
**A report is published with every release** of a reference implementation. The release step runs the benchmark, commits the two files here, and the site picks them up on its next deploy. Prefer a run over authorized real samples (`--corpus DIR`); a synthetic run is acceptable as a floor but is labelled as such and is not evidence of production savings.
|
||||
|
||||
## What the numbers mean, and do not
|
||||
|
||||
OpenStream is a framing envelope over Zstandard and gzip, not a new compression algorithm. A report measures those codecs at the block boundary, framed honestly. Read the `caveats` array in every report: a synthetic padded transport stream saves about its padding share and says more about the padding than the codec; an efficient real feed saves little; timings are for the one machine named in `environment`. The one number that is a pass/fail rather than a measurement is round-trip exactness, and it must hold for every applicable codec on every sample.
|
||||
Loading…
Add table
Add a link
Reference in a new issue