The Black Box Problem (Traceability & Audit Trail)
A regulator, auditor, or customer asks a simple question: "On this date, your system told this person X. What was that based on?" In many AI pilots, nobody can answer. The prompt was edited since then. The model version changed silently. The retrieved passages were never stored. The source document has been updated. The team can show what the system says today, but not what it said then or why.…