The four breakage classes — sort any LLM failure before you touch the prompt (step 2/9) · debugging broken ai output

promptdojo_

A chatbot told a customer their refund was processed. It wasn't. The trace shows retrieval pulled ticket ALT-CUST-04 instead of the customer's actual account CUST-04 — different customer, similar ID. The model read the ticket and answered honestly from it.

Which class is this?

A chatbot told a customer their refund was processed. It wasn't. The trace shows retrieval pulled ticket ALT-CUST-04 instead of the customer's actual account CUST-04 — different customer, similar ID. The model read the ticket and answered honestly from it.

Which class is this?

The four breakage classes — sort any LLM failure before you touch the prompt — step 2 of 9