P2-07: No precedent expiry / override / invalidation mechanism #17

New issue

Closed

opened 2026-06-16 13:57:01 +00:00 by Artur · 0 comments

Artur commented

2026-06-16 13:57:01 +00:00

Owner

Severity: P2 (Medium)
File: decider/precedent.py

Problem

Bad decisions (from LLM hallucination, config errors, prompt injection) become permanent precedents:

Once stored, a precedent is applied forever
No expiry TTL or re-evaluation trigger
No API to invalidate/override a precedent
No mechanism to flag a precedent as "under review"

Example: if the LLM wrongly approves rm -rf / once, that bad precedent repeats forever.

Fix

Add expires_at column (nullable) to precedents table
Add configurable default TTL (e.g. 30 days)
Add API endpoint: POST /precedents/{id}/invalidate (logical delete)
Add CLI flags: --precedent-expire, --precedent-invalidate
Track precedent accuracy: add outcome field (success/failure) that gets updated when a follow-up shows the decision was right or wrong

**Severity**: P2 (Medium) **File**: `decider/precedent.py` ## Problem Bad decisions (from LLM hallucination, config errors, prompt injection) become permanent precedents: - Once stored, a precedent is applied forever - No expiry TTL or re-evaluation trigger - No API to invalidate/override a precedent - No mechanism to flag a precedent as "under review" Example: if the LLM wrongly approves `rm -rf /` once, that bad precedent repeats forever. ## Fix 1. Add `expires_at` column (nullable) to precedents table 2. Add configurable default TTL (e.g. 30 days) 3. Add API endpoint: `POST /precedents/{id}/invalidate` (logical delete) 4. Add CLI flags: `--precedent-expire`, `--precedent-invalidate` 5. Track precedent accuracy: add `outcome` field (success/failure) that gets updated when a follow-up shows the decision was right or wrong

Artur added the

enhancement

reliability

P2-Medium

labels

2026-06-16 13:57:01 +00:00

Artur referenced this issue from a commit

2026-06-16 14:00:59 +00:00

feat: P2-07 — precedent expiry, invalidation, and outcome tracking

Artur closed this issue

2026-06-16 14:00:59 +00:00