Large Language Models (LLMs) Locally - spinningideas/resources GitHub Wiki
Below is a list of ways to run ML Models Locally
Best
- https://github.com/spinningideas/resources/wiki/ollama-openwebui
- https://ollama.com/ - Run Llama 2, Code Llama, and other models
- openwebui
- https://github.com/ollama-webui/ollama-webui - ChatGPT like UI with easy way to download models
- https://lmstudio.ai/ - https://www.youtube.com/watch?v=yBI1nPep72Q
- https://github.com/oobabooga/text-generation-webui - Supports any model format and has many extensions
- librechat
Better
- https://github.com/huggingface/chat-ui - Amazing clean UI with very good web search
- https://useanything.com/
- https://gpt4all.io/ - Many LLMs may be run locally with GPT4All
- https://mindmac.app - non-subscription app that uses multiple AI tools (not just OpenAI).
- https://www.typingmind.com
- https://www.nvidia.com/en-us/ai-on-rtx/chatrtx/
- https://github.com/PromtEngineer/localGPT
- Streamlit
- Gradio
- https://github.com/abi/secret-llama - open-source, fully private chatbot that runs entirely in the browser
Good
-
https://github.com/ParisNeo/lollms-webui/ - Has PDF, stable diffusion and web search integration
-
https://github.com/h2oai/h2ogpt - Has PDF, Web search, best for files ingestion (supports many file formats)
-
https://github.com/SillyTavern/SillyTavern - Best for custom characters and roleplay
-
https://github.com/NimbleBoxAI/ChainFury - Has great UI and web search (experimental)
-
https://github.com/nomic-ai/gpt4all - Basic UI that replicates ChatGPT
-
https://github.com/imartinez/privateGPT - Basic UI that replicated ChatGPT with PDF integration
-
https://github.com/LostRuins/koboldcpp - Easy to install and simple interface LM Studio - Clean UI, focuses on GGUF format
-
https://github.com/lobehub/lobe-chat - Nice rich UI with the ability to load extensions for web search, TTS and more
-
https://github.com/turboderp/exui - fast and vram efficient
-
https://github.com/PromtEngineer/localGPT - Focuses on PDF files
-
https://github.com/shinomakoi/AI-Messenger - Supports EXLv2 and LLava