Builder · RAG Quality System
Delta Support Audit
Found 291 contradictions between support articles and the docs. 222 are fixed.
Builder & triager · 2026 · Next.js 15 / TypeScript · OpenRouter → Claude Sonnet · Upstash Redis + Vector · BGE-large-en-v1.5 embeddings · RAG · Slack + Notion
The problem
Support content drifts. Articles fall out of step with the guides and developer docs that are the real source of truth, and nobody notices until a customer acts on the wrong number.
One live article told users their NEFT deposits would be rejected and refunded. The official guide described NEFT as supported, with a 30-minute ETA. Both were published at the same time.
What it caught
217 published articles, audited against the canonical India guide and the developer docs. 291 findings: 35 P0, 62 coverage gaps, 190 spelling and grammar, 4 conflicts.
222 are now verified fixed, 76% of all drift. Every resolved finding gets an automated re-check that confirms the original quote no longer appears in the live article.
One article had shipped with its own authoring instruction still in the body: “Write a proper article on it. Dont make it too long.”
How it works
Each article is embedded into a vector store and compared against the docs. RAG detectors classify it for contradictions, coverage gaps and conflicts. P0 issues page a Slack channel. The full triage sheet lands in Notion and Google Sheets, where a human sets the verdict.
A full sweep costs $5.36 and takes 11 minutes. It ran daily at 04:00 IST through the Phase 1 push. The schedule is paused now that the backlog is cleared, and the dashboard serves the completed report.
Colophon
Next.js 15 / TypeScript · OpenRouter → Claude Sonnet · Upstash Redis + Vector · BGE-large-en-v1.5 embeddings · RAG · Slack + Notion · Vercel Cron
