AnythingLLM
Private AI chat app for your documents, with agents, runs locally or with cloud models.
- Stars
- 67.8k
- Forks
- 7.7k
- Licence
- MIT
- Language
- JavaScript
- Last update
- 6 days ago
- Type
- App
What it is
AnythingLLM is an all-in-one AI application that lets you chat with your own documents and use AI agents. You can connect a local model that runs on your own computer or a cloud model from a provider such as OpenAI or Anthropic. The README says it includes built-in agents, multi-user support, vector databases, and document pipelines, and is available as a desktop app for Mac, Windows, and Linux.
- Ask questions about a folder of your own documents and get answers with source citations
- Create custom AI agents or no-code agent flows for repeated tasks
- Schedule recurring prompts or tasks on a cron schedule
- Embed a chat widget on your website (Docker version)
Great for
- People who want a private ChatGPT-style assistant over their own PDFs and text files
- Teams that need several users with separate access on one instance (Docker version)
- Developers who want to try many LLM providers from one interface
- Anyone who wants to run local models on their own CPU or GPU without much setup
Not ideal for
- People who only want a simple hosted chatbot and do not want to install or manage anything; a hosted instance exists but is a paid option
- Users needing multi-user permissions or the embeddable website widget, which the README marks as Docker version only
- Anyone expecting a guaranteed result from local models, since output quality depends on the model you choose
How to get it
- 1
Download the app
Clone the repository
git clone https://github.com/Mintplex-Labs/anything-llm.git - 2
Run it
- Download the desktop installer for your operating system from the project's download page or the latest release
- Install and open AnythingLLM
- Connect a language model, either a built-in local engine or a cloud provider with your API key
- Create a workspace and upload a document to start chatting
- 3
Get the most out of it
- Use the Docker version if you need multi-user permissions or the embeddable chat widget
- Try Dynamic Model Routing to send different chats to different providers based on rules you set
- Add Memories so the model remembers key facts about you or your workspace
- Use Intelligent Skill Selection to enable many tools while reducing token use, as the README claims
Downloads
Strengths
- Works with many LLM providers, both local and cloud, as listed in the README
- Desktop installers are provided for Mac, Windows, and Linux
- Released under the MIT license with a large community on GitHub
Trade-offs
- Several features, including multi-user support and the website widget, are limited to the Docker version
- The README is long and lists many options, so setup choices take some reading
- Local model performance depends on your hardware and the model you pick
How it compares
| Project | Stars | Type | Level | Updated | Best for |
|---|---|---|---|---|---|
| anything-llm (this) | 67.8k | App | beginner | 6 days ago | People who want a private ChatGPT-style assistant over their own PDFs and text files |
| PageIndex | 40k | Library | intermediate | 7 days ago | Developers building question-answering over long PDFs such as annual reports or manuals |
| paperclip | 110k | App | advanced | 4 days ago | Developers already running several AI coding agents who want one place to track them |
| Vane | 38k | App | intermediate | 2 months ago | People who want AI-written answers with links to sources |
| Octop | 11.5k | App | intermediate | 4 days ago | Households or small teams that want a shared, self-hosted assistant |
| serviette | 58.7k | App | intermediate | 21 days ago | Teams that want a chat over internal documents without writing code |
Stats synced from GitHub. The assessment above was drafted with AI from the project's README on 2026-10-29 and may miss recent changes — check the README before relying on a command. MIT licence: free to use, modify and distribute, including commercially, as long as you keep the copyright notice.