Home/Catalog/Quality
Quality — does it work?
Brief 100

Test-Quality Audit

Whether the tests actually protect the code — asserting meaningful behavior, or merely executing lines and passing no matter what.

TESTQUALITY.md4 phases7 lenses~2.6k chars

Free & open · no signup · read-only — it ends by asking · nothing leaves your machine

What it does

You are working inside this repo. Mission: judge whether the test suite would actually catch a regression — whether tests assert real behavior or just run code and pass. High coverage that asserts nothing is a false sense of safety.

Read-only pass. Read the tests and what they cover; change nothing but the report file.

What it looks for

7 lenses it looks through

Phase 2 sweeps the codebase through every one of these, citing file and line for each finding.

1

Assertion strength

tests that exercise code but assert little; snapshot-only "coverage"

2

Behavior vs implementation

tests bound to internals that break on refactor and miss real regressions

3

Coverage honesty

high line coverage hiding untested branches, error paths, and edges

4

Meaningful failure

would each test actually fail if the behavior broke

5

Data realism

fixtures that dodge the hard cases: empty, huge, malformed, boundary

6

Isolation

tests that pass only in order, share state, or depend on the clock or network

7

Critical-path priority

is the risky, valuable logic tested, or only the easy getters

The deliverable

What lands in your repo

One structured report at the repo root — or in reports/, if you keep one — the same shape every time, ready for a teammate — or the optional Studio — to act on.

TESTQUALITY.md
1
Weakest tests
ranked by the risk they pretend to cover, each with what it should assert
2
Untested in practice
paths with coverage but no meaningful assertion
3
Critical gaps
high-value logic that needs real tests, prioritized
4
What good looks like
an example rewrite turning a hollow test into a real one
One file. Evidence-backed. It ends by asking before touching anything.
How it works

What it makes the agent do

Every Goal Prompt follows the same four steps, so results are consistent and repeatable — no matter which one you run.

1
Phase 1

Read the tests, not the coverage number

Sample tests across the critical paths and read what they assert.

2
Phase 2

Audit through 7 lenses

Assertion strength — tests that exercise code but assert little.

3
Phase 3

Curate

Rank by risk left uncovered.

4
Phase 4

Report

Create TESTQUALITY.md at repo root.

Get started

Three ways to run this Goal Prompt

01 · COPY

Paste it in

Copy it and paste it into your agent inside the repo you want checked.

02 · INSTALL

As a slash command

Install the goal plugin once — two commands — then just type /goal:test-quality.

1/plugin marketplace add GhostlyGawd/goal-prompts
2/plugin install goal@goal-prompts

Or install only this Goal Prompt as /goal-test-quality:

curl -fsSL https://goal-prompts.vercel.app/install | BRIEF=100 sh
03 · AGENT

From an agent (MCP)

Let an agent fetch it mid-conversation, or pull the raw Goal Prompt by URL.

https://goal-prompts.vercel.app/raw/100.md
Transparency

The exact prompt

Nothing hidden — this is the whole Goal Prompt, verbatim. Read it in a minute, edit it, or copy it as-is.

Read the full brief (2,596 characters)
# Goal: Test-Quality Audit

You are working inside this repo. Mission: judge whether the test suite would actually catch a regression — whether tests assert real behavior or just run code and pass. High coverage that asserts nothing is a false sense of safety.

Read-only pass. Read the tests and what they cover; change nothing but the report file.

## Phase 1 — Read the tests, not the coverage number
- Sample tests across the critical paths and read what they assert.
- Note where coverage is high but assertions are thin or absent.
- Identify the risky, high-value logic and check how seriously it is tested.

## Phase 2 — Audit through 7 lenses
1. **Assertion strength** — tests that exercise code but assert little; snapshot-only "coverage"
2. **Behavior vs implementation** — tests bound to internals that break on refactor and miss real regressions
3. **Coverage honesty** — high line coverage hiding untested branches, error paths, and edges
4. **Meaningful failure** — would each test actually fail if the behavior broke
5. **Data realism** — fixtures that dodge the hard cases: empty, huge, malformed, boundary
6. **Isolation** — tests that pass only in order, share state, or depend on the clock or network
7. **Critical-path priority** — is the risky, valuable logic tested, or only the easy getters

## Phase 3 — Curate
- Rank by risk left uncovered: weak tests on money or auth outrank a thin test on a label.
- For each weak test, say what it should assert instead.
- Name the untested-in-practice paths — covered by a line but not by a real check.

## Phase 4 — Report
Create `TESTQUALITY.md` at repo root:
1. **Weakest tests** — ranked by the risk they pretend to cover, each with what it should assert
2. **Untested in practice** — paths with coverage but no meaningful assertion
3. **Critical gaps** — high-value logic that needs real tests, prioritized
4. **What good looks like** — an example rewrite turning a hollow test into a real one

Start the report with today's date. If `TESTQUALITY.md` already exists from a previous run, read it first and lead with what changed since.

## Rules
- Coverage measures lines run, not behavior verified; judge the assertions
- A test that cannot fail is documentation, not protection
- No tests to grade in this repo? Say so in a one-paragraph null report and stop — a null result is a valid finding.
- If a `reports/` directory exists at the repo root, write the report there instead of the root.
- Before asking, present the top findings as a ranked list in plain words
- Report only — end by asking which tests to strengthen first

House rules for this Goal Prompt

  • Coverage measures lines run, not behavior verified; judge the assertions
  • A test that cannot fail is documentation, not protection
  • No tests to grade in this repo? Say so in a one-paragraph null report and stop — a null result is a valid finding.
  • If a reports/ directory exists at the repo root, write the report there instead of the root.
  • Before asking, present the top findings as a ranked list in plain words
  • Report only — end by asking which tests to strengthen first
Keep exploring

More Quality briefs

Runs inside these playbooks — curated sequences you can launch with one paste: