Home/Catalog/Automation
Automation — does the process hold?
Brief 40

Determinism Boundary Audit

LLM calls that should be plain code, rigid code that should be judgment — redraw the line between deterministic and model-driven.

BOUNDARIES.md4 phases6 lenses~2.8k chars

Free & open · no signup · read-only — it ends by asking · nothing leaves your machine

What it does

You are working inside this repo. Mission: audit where the line sits between deterministic code and model judgment — and redraw it where the wrong side is doing the work.

Read-only pass. Your only write is the report file.

What it looks for

6 lenses it looks through

Phase 2 sweeps the codebase through every one of these, citing file and line for each finding.

1

LLM-that-should-be-code

fixed transforms, structured-data parsing, arithmetic, template filling, date math: paying tokens and accepting nondeterminism where a function is free and exact

2

Code-that-should-judge

brittle rules drowning in exceptions; keyword matching approximating meaning; the if-tree that grows a branch per support ticket

3

Hybrid seams

the strong pattern: model extracts, code validates; code narrows candidates, model decides; neither side alone

4

Missing validation

model output consumed directly where a deterministic check exists (schema, range, referential integrity, checksum)

5

Consistency contracts

places the same input must yield the same output — then why is sampling nondeterministic there?

6

The escalation ladder

rules → small model → big model → human: does a ladder exist, or does everything ride the most expensive rung?

The deliverable

What lands in your repo

One structured report at the repo root — or in reports/, if you keep one — the same shape every time, ready for a teammate — or the optional Studio — to act on.

BOUNDARIES.md
1
Inventory
call/rule · side today · verdict: keep / demote-to-code / promote-to-model / hybrid
2
Migrations
each: change · expected deltas · eval or test to run first
3
The ladder
the escalation design for this product
4
Keep list
judgment that has earned its tokens
5
The boundary principle
one paragraph stating this codebase's rule
One file. Evidence-backed. It ends by asking before touching anything.
How it works

What it makes the agent do

Every Goal Prompt follows the same four steps, so results are consistent and repeatable — no matter which one you run.

1
Phase 1

Inventory both sides

Every model call.

2
Phase 2

Audit through 6 lenses

LLM-that-should-be-code — fixed transforms, structured-data parsing, arithmetic, template filling, date math.

3
Phase 3

Curate

Each migration carries expected deltas.

4
Phase 4

Report

Create BOUNDARIES.md at repo root.

Get started

Three ways to run this Goal Prompt

01 · COPY

Paste it in

Copy it and paste it into your agent inside the repo you want checked.

02 · INSTALL

As a slash command

Install the goal plugin once — two commands — then just type /goal:determinism-boundary-audit.

1/plugin marketplace add GhostlyGawd/goal-prompts
2/plugin install goal@goal-prompts

Or install only this Goal Prompt as /goal-determinism-boundary-audit:

curl -fsSL https://goal-prompts.vercel.app/install | BRIEF=40 sh
03 · AGENT

From an agent (MCP)

Let an agent fetch it mid-conversation, or pull the raw Goal Prompt by URL.

https://goal-prompts.vercel.app/raw/40.md
Transparency

The exact prompt

Nothing hidden — this is the whole Goal Prompt, verbatim. Read it in a minute, edit it, or copy it as-is.

Read the full brief (2,817 characters)
# Goal: Determinism Boundary Audit

You are working inside this repo. Mission: audit where the line sits between deterministic code and model judgment — and redraw it where the wrong side is doing the work.

Read-only pass. Your only write is the report file.

## Phase 1 — Inventory both sides
- Every model call: input variability, correctness requirement, volume, cost, latency.
- Every complex rule system: regex forests, keyword lists, giant if-trees, scoring heuristics — and the edge-case patches accreted around them (check git log for their churn).

## Phase 2 — Audit through 6 lenses
1. **LLM-that-should-be-code** — fixed transforms, structured-data parsing, arithmetic, template filling, date math: paying tokens and accepting nondeterminism where a function is free and exact
2. **Code-that-should-judge** — brittle rules drowning in exceptions; keyword matching approximating meaning; the if-tree that grows a branch per support ticket
3. **Hybrid seams** — the strong pattern: model extracts, code validates; code narrows candidates, model decides; neither side alone
4. **Missing validation** — model output consumed directly where a deterministic check exists (schema, range, referential integrity, checksum)
5. **Consistency contracts** — places the same input must yield the same output — then why is sampling nondeterministic there?
6. **The escalation ladder** — rules → small model → big model → human: does a ladder exist, or does everything ride the most expensive rung?

## Phase 3 — Curate
- Each migration carries expected deltas: reliability, cost, latency, maintenance
- List what stays model-driven on purpose — genuine judgment, genuine variability — so nobody "optimizes" it later

## Phase 4 — Report
Create `BOUNDARIES.md` at repo root:
1. **Inventory** — call/rule · side today · verdict: keep / demote-to-code / promote-to-model / hybrid
2. **Migrations** — each: change · expected deltas · eval or test to run first
3. **The ladder** — the escalation design for this product
4. **Keep list** — judgment that has earned its tokens
5. **The boundary principle** — one paragraph stating this codebase's rule

Start the report with today's date. If `BOUNDARIES.md` already exists from a previous run, read it first and lead with what changed since.

## Rules
- Determinism is a feature: never spend variance where exactness is required
- Judgment is a feature too: never fake it with a thousand rules
- No automation mixing deterministic and model-driven steps in this repo? Say so in a one-paragraph null report and stop — a null result is a valid finding.
- If a `reports/` directory exists at the repo root, write the report there instead of the root.
- Before asking, present the top findings as a ranked list in plain words
- Report only — end by asking which migrations to make

House rules for this Goal Prompt

  • Determinism is a feature: never spend variance where exactness is required
  • Judgment is a feature too: never fake it with a thousand rules
  • No automation mixing deterministic and model-driven steps in this repo? Say so in a one-paragraph null report and stop — a null result is a valid finding.
  • If a reports/ directory exists at the repo root, write the report there instead of the root.
  • Before asking, present the top findings as a ranked list in plain words
  • Report only — end by asking which migrations to make
Keep exploring

More Automation briefs