Event-driven RAG over multi-tenant knowledge bases
- Problem
- A multi-tenant B2B platform's conversational AI answered from each tenant's own knowledge base, but infrastructure cost was scaling faster than usage as tenants and LLM workflows multiplied.
- Approach
- Re-engineered the pipeline into decoupled event-driven stages on AWS, restructured retrieval around Typesense, and consolidated orchestration so multi-LLM conversational workflows share a single retrieval layer.
- Impact
- Cut RAG infrastructure cost by ~50% while serving production multi-tenant traffic: 1.2M+ answers served to date, peaking at 148k in a single month. The pipeline became the foundation for every AI feature shipped after it.
Proprietary production system (NDA) · architecture walkthrough on request







