Practical overview
When it fits
Use Chatdocs when you want a locally run document-chat workflow and can install the tool and download models before working offline.
Who it is for
- People who want to ask questions across personal or work document collections while keeping source files on their own system.
- Developers setting up a self-hosted document-question-answering interface.
Documented uses
- Add a folder of documents to a local searchable collection.
- Ask questions about the collection through a browser UI or CLI.
- Choose supported language-model and embeddings configurations.
Requirements & limits
The README documents installation with pip and use through a local web interface at localhost:5000 or the command line. Internet access is required to install the tool and download models; the project says it can then run offline.
- Processed documents are stored in a local
dbdirectory by default. - The project supports GGML/GGUF through CTransformers, Transformers, and GPTQ models.
- A configurable YAML file controls model choices and other settings.
- CUDA settings are documented for embeddings and supported model backends; additional CUDA-enabled packages or PyTorch installation may be needed.
Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.
Set up a local document collection and open the chat
Install Chatdocs, prepare a document folder for local search, and open its web interface.
Before you start
- Python package installation with pip
- Internet access for installation and model downloads
- A directory containing supported documents
Steps
Install the package with the command below.
pip install chatdocsDownload AI models with
chatdocs download.Add a document directory with
chatdocs add /path/to/documents; processed files are stored indbby default.Run
chatdocs uiand openhttp://localhost:5000in a browser.
Expected outcome
A local web interface for chatting with the added documents; the README says Chatdocs can run offline after installation and model downloads.
Guide limitations
- Installation and model downloads require an internet connection.
- Changing the embeddings model requires deleting
dband adding documents again.
Sources & review
Source record details
- Source availability
- Active
- Sources checked
- 17 October 2026
- Original website title
- marella/chatdocs · Official homepage title · retained in its source language

