Software Stack

See ENVSETUP.md for instructions on setting up the software environment.

• LLM: Choice of:
  • OpenAI (Recommended)
  • OpenAI compatibility API (LM Studio, Oobabooga, etc)
  • Tabby (tabbyAPI)
  • Ollama
  • Deepinfra
• Text-to-Speech: Choice of:
  • Azure TTS
  • Local (E-speak)
  • Local (Piper TTS with custom Voice model) (Recommended)
  • XTTSv2 with voice cloning (xtts-api-server)
  • Alltalk
  • Silero
  • Eleven Labs
• Speech-to-Text:
  • Vosk
  • Whisper
  • Faster-Whisper
  • Externally hosted Whisper
• Vision Handling:
  • Saleforce Blip
• Tool Utilization:
  • Custom Module Engine
  • Function Calling (two methods)
  • Stable Diffusion
  • Dall-e
  • Home Assistant
  • Volume Control
  • Persona Settings