CSS frameworks · Framework 08 of 09
Four Ways It Breaks
AI systems fail four ways: the model changes, the prompt drifts, the data changes, or a vendor changes a connection. Fractional Product Lead watches all four weekly. Strategic Partner reviews models, prompts, and connections monthly. Every tier keeps connections working.
Why it matters
An AI workflow that worked in March can quietly stop working in June with nothing in your business having changed.
A model update shifts how drafts read; six months of small edits leave the prompt contradicting itself; a new field appears in the job record; a vendor moves an API.
You find out from an angry customer unless someone is watching the four places it can come from.
How we apply it
- At handoff, each of the four sources gets a check: a re-run of your output tests, a prompt diff, a data schema check, and connection monitoring with alerts to us. Fractional Product Lead runs all four every week.
- On Fractional Product Lead, the weekly report shows all four columns, including the weeks with nothing in them, so you can see the watching happen.
- When something drifts, we log the incident by source and fix it. If that month's report showed the column clear and it still reached a customer, the fix is free. Otherwise we agree the work within your monthly scope.
- Quarterly we check whether the workflow still pays at your current volume, and say so either way.
The number
| Measure | Cadence | Baseline |
|---|---|---|
| Incidents caught before a customer saw them, by source | Monthly | Zero incidents at launch |
| Incidents a customer or tech reported first | Monthly | Target zero |
| Output-check pass rate | Monthly | Launch report |
| AI cost per completed job | Monthly | Launch report |
Where it ran
- Corporate Synergy Solutions (Client Zero): We run our own business on the rules we sell, and content takes 90 minutes a week, not 12 hours.
Who is accountable
If a drift from one of the four sources reaches a customer and our report that month shows that column clear, the fix is free.
Direct Advisory answers within 24 business hours, the higher tiers sooner, and we say in writing if the workflow stops paying for itself.
Where you meet it
Monitoring, review and improvement are agreed within your monthly Partnership Tier scope.
A common question
Four Ways It Breaks, asked and answered.
Isn't this just maintenance?
Maintenance fixes what broke. This watches the four places breakage comes from, so the fix happens before a customer notices, and you can see the empty columns in the months nothing did.