AI Private GPT Installation - LeandroTheDev/arch_linux GitHub Wiki

Reference: PrivateGPT4Linux

Downloading Dependencies

• sudo pacman -S python python-tensorflow icu pyenv

Use git to download the PrivateGPT

• git clone https://github.com/imartinez/privateGPT
• pyenv install 3.11
• pyenv local 3.11

Running ollama on background

• nohup env OLLAMA_HOST=0.0.0.0:11434 ollama serve &

Adding basic model -> you can view models here

• ollama pull mistral
• ollama pull nomic-embed-text

Installing PrivateGPT dependencies

• poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant"

Running

• PGPT_PROFILES=ollama make run