Open-source AI assistants

4 AI assistants whose code is public under an OSI-approved license, rated for privacy with evidence. Picks first, then by score.

1. Jan Grade B

   Open-source desktop app for running large language models offline on a local computer, with optional connections to remote AI APIs.

   Apache-2.0. Source code

2. llama.cpp Grade B

   Open-source C/C++ library and command-line tools for running large language model inference locally on CPUs and GPUs, including a built-in web server and chat interface.

   MIT. Source code

3. Ollama Grade B

   Open-source tool for downloading and running large language models on a local computer through a command line, API and desktop app. Optional cloud-hosted models are also offered.

   MIT. Source code

4. GPT4All Grade C

   Open-source desktop app from Nomic for running large language models locally, including chatting with local documents.

   MIT. Source code

Compare all 18 AI assistants, open source or not.