AI Website Knowledge Chatbot
Multi-tenant RAG Pipeline & Web Crawler
Engineered a production-ready multi-tenant RAG pipeline crawling customer websites, computing local embeddings with Ollama, storing vector representations in MongoDB Atlas, and generating grounded contextual responses via Google Gemini.
Pipeline
- 1Web Crawler (Cheerio/Playwright)
- 2Text Chunking
- 3Ollama (Nomic)
- 4Atlas Vector Search
- 5Gemini Grounded Answer
Outcome
10+ client websites, 100+ indexed pages, strict per-tenant data isolation
10+ client websites, 100+ indexed pages, strict per-tenant data isolation