Skip to content

feat(docs): one quality matrix with SIG stars, our own measures and the gates - #910

Merged
rubenvdlinde merged 4 commits into
mainfrom
feat/quality-matrix-page
Nov 7, 2026
Merged

rubenvdlinde merged 4 commits into
mainfrom
feat/quality-matrix-page

Conversation

@rubenvdlinde

Copy link
Copy Markdown
Contributor

Stacked on #909 (it uses gate 122's star bands): merge #909 first.

The SIG scores page becomes one quality matrix, apps as columns:

  1. SIG maintainability, v18.1, 5 to 1 stars per check.
  2. SIG's other models where we measure them: Open Source Health (vulnerabilities, licence risk, unmanaged dependencies) and Architecture Quality (component adjacency), against the published 4-star values.
  3. Our own measures with bands and their basis (website/scripts/quality_measures.py): PHP coverage, spec coverage, e2e coverage, test code ratio; baseline debt and suppressions per kLOC; security gate findings, high/critical audit findings, unmanaged dependencies; accessibility findings per .vue file, UI findings.
  4. Gates per category, passing out of applicable plus findings, expandable to each gate.
    Below it: "What we add beyond SIG". Search, sticky header, both scrollbars and dark mode kept; new star colours for 3, 2 and 1 stars.

Draft: the data is not final. sig-matrix.json in this commit is a two-app trial (buildiq, decidiq). The full measurement of all 20 apps (gate 122 reports plus full-scope gate runs) is still running in ~/sig-lanes/matrix/; the data refresh is one commit with build-sig-matrix.py ../sig --clones ../clones --gates ../out.

Verified: npm run build of the website succeeds (en and nl) with the new page.

AI assistance: written with Claude Code (Opus); reviewed by the submitter before merge.

…tes.json per run

Gate 122 now rates against the 4-star limits of the SIG/TUV NORD CERT
Guidance for Producers v18.1 (2026 model): unit size 48.0/24.2/9.1%,
complexity 20.7/7.5/1.1%, interfacing 15.4/3.4/0.9%, coupling 9.7/5.3/1.8%,
duplication 5.8%, entanglement 0.075, independence 94.5%. Volume is not
rated. Every report row carries the star level its share earns: 5, 3 and 2
stars from the v18.1 limits scaled by the band ratios of Alves, Correia and
Visser 2011 (duplication: Heitlager 2007), 1 star below 2. Independence and
entanglement have 5 stars at half the 4-star exposure and no band under 4.
The five-star profile uses the derived 5-star band instead of half of each
4-star limit.

Gate 123 records the guidance in the floor file and never lowers a floor on
re-recording: a floored check the new limits miss stays in the file and is
named, so the change of status is visible.

The runner writes gates.json next to the findings logs: every declared gate
with its verdict, findings count, scope and matrix category.

Assisted-by: ClaudeCode:claude-opus-5-5
…he gates

The SIG scores page becomes the quality matrix: SIG maintainability on the
v18.1 limits with all five star levels, SIG's Open Source Health and
Architecture Quality rows where we measure them, our own banded measures for
tests, debt, security and accessibility, and one row per gate category that
opens to its gates. A table below the matrix states why each own measure is
there and the basis of its bands.

Assisted-by: ClaudeCode:claude-opus-5-5
@rubenvdlinde
rubenvdlinde marked this pull request as ready for review November 5, 2026 08:56
@rubenvdlinde
rubenvdlinde merged commit 89ad667 into main Nov 7, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant