Inspect what was measured before interpreting quality. This page is anchored to v0.2.2, release contract release-baseline-v1, run 0ece7383-c9ac-41ca-a5b8-7bc84753a6f9. It does not add another ranking axis.
Data contract: measurement-health-v1
Any-tool measurable subjects stay in every tool's metric denominator; a missing peer measurement is a miss.
Comparable outcomes
Semantic uses the shared missing-as-miss denominator. GED and type show exact diagnostic matches. Compile is decompiled-C recompilation, not semantic ranking.
| Decompiler | Output clean | Semantic · observed/shared | GED exact · observed/shared | Type exact · observed/shared | Compiles | Byte match |
|---|---|---|---|---|---|---|
| fission | 98.6% · 213/216 | 64.1% · 213/216 | 12.0% · 213/216 | 34.7% · 213/216 | 90.7% · 196/216 | 2.8% |
| ghidra | 99.5% · 215/216 | 72.7% · 215/216 | 27.3% · 215/216 | 56.0% · 215/216 | 78.2% · 169/216 | 6.5% |
Difficulty mix
Structural proxy: easy >= 2/3 exact GED agreement, hard <= 1/3, medium otherwise; unmeasured is explicit.
| Tool | Easy semantic | Medium | Hard |
|---|---|---|---|
| fission | 19/22 | 19/41 | 67/153 |
| ghidra | 17/22 | 21/41 | 119/153 |
Pipeline health
Source and decompiled CFG extraction are separate so parser loss cannot masquerade as tool quality.
- Source CFG
- 216/216 (100.0%)
- Source basis
- preprocessed_tu 216
- Oracle
- 428/432 tested · 0 no wrapper
| Tool | Output CFG |
|---|---|
| fission | 213/216 · 98.6% |
| ghidra | 215/216 · 99.5% |
Failure causes
Exclusive row taxonomy; successful rows are omitted from the cause list.
| Tool | Non-zero causes |
|---|---|
| fission | whole_program_output 3 · compile_error 24 · runtime_error 11 · timeout 3 · assertion_fail 69 · fixture_error 1 |
| ghidra | whole_program_output 1 · compile_error 20 · timeout 1 · fixture_error 1 · oracle_error 36 |
Execution cost
Per-function wall time is comparable within this run. USD is null unless an explicit priced execution source exists.
| Tool | Mean | p50 | p95 | Total | USD |
|---|---|---|---|---|---|
| fission | 1.38s | 1.20s | 3.05s | 297.95s | N/A |
| ghidra | 11.69s | 9.59s | 27.42s | 2525.57s | N/A |