Whether the tests actually protect the code — asserting meaningful behavior, or merely executing lines and passing no matter what.
Free & open · no signup · read-only — it ends by asking · nothing leaves your machine
You are working inside this repo. Mission: judge whether the test suite would actually catch a regression — whether tests assert real behavior or just run code and pass. High coverage that asserts nothing is a false sense of safety.
Read-only pass. Read the tests and what they cover; change nothing but the report file.
Phase 2 sweeps the codebase through every one of these, citing file and line for each finding.
tests that exercise code but assert little; snapshot-only "coverage"
tests bound to internals that break on refactor and miss real regressions
high line coverage hiding untested branches, error paths, and edges
would each test actually fail if the behavior broke
fixtures that dodge the hard cases: empty, huge, malformed, boundary
tests that pass only in order, share state, or depend on the clock or network
is the risky, valuable logic tested, or only the easy getters
One structured report at the repo root — or in reports/, if you keep one — the same shape every time, ready for a teammate — or the optional Studio — to act on.
Every Goal Prompt follows the same four steps, so results are consistent and repeatable — no matter which one you run.
Sample tests across the critical paths and read what they assert.
Assertion strength — tests that exercise code but assert little.
Rank by risk left uncovered.
Create TESTQUALITY.md at repo root.
Copy it and paste it into your agent inside the repo you want checked.
Install the goal plugin once — two commands — then just type /goal:test-quality.
/plugin marketplace add GhostlyGawd/goal-prompts/plugin install goal@goal-promptsOr install only this Goal Prompt as /goal-test-quality:
curl -fsSL https://goal-prompts.vercel.app/install | BRIEF=100 shLet an agent fetch it mid-conversation, or pull the raw Goal Prompt by URL.
https://goal-prompts.vercel.app/raw/100.mdNothing hidden — this is the whole Goal Prompt, verbatim. Read it in a minute, edit it, or copy it as-is.
# Goal: Test-Quality Audit You are working inside this repo. Mission: judge whether the test suite would actually catch a regression — whether tests assert real behavior or just run code and pass. High coverage that asserts nothing is a false sense of safety. Read-only pass. Read the tests and what they cover; change nothing but the report file. ## Phase 1 — Read the tests, not the coverage number - Sample tests across the critical paths and read what they assert. - Note where coverage is high but assertions are thin or absent. - Identify the risky, high-value logic and check how seriously it is tested. ## Phase 2 — Audit through 7 lenses 1. **Assertion strength** — tests that exercise code but assert little; snapshot-only "coverage" 2. **Behavior vs implementation** — tests bound to internals that break on refactor and miss real regressions 3. **Coverage honesty** — high line coverage hiding untested branches, error paths, and edges 4. **Meaningful failure** — would each test actually fail if the behavior broke 5. **Data realism** — fixtures that dodge the hard cases: empty, huge, malformed, boundary 6. **Isolation** — tests that pass only in order, share state, or depend on the clock or network 7. **Critical-path priority** — is the risky, valuable logic tested, or only the easy getters ## Phase 3 — Curate - Rank by risk left uncovered: weak tests on money or auth outrank a thin test on a label. - For each weak test, say what it should assert instead. - Name the untested-in-practice paths — covered by a line but not by a real check. ## Phase 4 — Report Create `TESTQUALITY.md` at repo root: 1. **Weakest tests** — ranked by the risk they pretend to cover, each with what it should assert 2. **Untested in practice** — paths with coverage but no meaningful assertion 3. **Critical gaps** — high-value logic that needs real tests, prioritized 4. **What good looks like** — an example rewrite turning a hollow test into a real one Start the report with today's date. If `TESTQUALITY.md` already exists from a previous run, read it first and lead with what changed since. ## Rules - Coverage measures lines run, not behavior verified; judge the assertions - A test that cannot fail is documentation, not protection - No tests to grade in this repo? Say so in a one-paragraph null report and stop — a null result is a valid finding. - If a `reports/` directory exists at the repo root, write the report there instead of the root. - Before asking, present the top findings as a ranked list in plain words - Report only — end by asking which tests to strengthen first
reports/ directory exists at the repo root, write the report there instead of the root.Trace latent bugs, unhandled edge cases, and race conditions; rank by user pain with repro paths and fix sketches.
Map what is tested against what is riskiest, and produce a test-writing plan that buys the most safety per hour.
Find swallowed errors, missing logs, and monitoring blind spots — everywhere the system can break without anyone knowing.
The bugs that only appear under load — races, shared mutable state, and ordering assumptions that hold on a quiet laptop and break in production.
Runs inside these playbooks — curated sequences you can launch with one paste: