README - GGUFloader/gguf-loader GitHub Wiki
π Machine-readable metadata available
GGUF Loader
A beginner-friendly, privacy-first desktop application for running gpt oss models locally on Windows. Run models like Mistral, LLaMA, DeepSeek, and others in GGUF format with zero setup required.
Download EXE file for Windows
π Install in One Line
pip install ggufloader
ggufloader
𧩠π¬ Demo Video: Addon System + Floating Tool in Local LLM (v2.0.1 Update)
Discover how to supercharge your local AI workflows using the new floating addon system! No coding needed. Works offline.
Works on Windows, Linux
π½ Download GGUF Models
β‘ Click a link below to download the model file directly (no Hugging Face page in between).
π§ GPT-OSS Models (Open Source GPTs)
High-quality, Apache 2.0 licensed, reasoning-focused models for local/enterprise use.
π§ GPT-OSS 120B (Dense)
π§ GPT-OSS 20B (Dense)
π§ Mistral-7B Instruct
π§ Qwen 1.5-7B Chat
π§ DeepSeek 7B Chat
π§ LLaMA 3 8B Instruct
ποΈ More Model Collections
Development Roadmap
| Phase | Timeline | Status | Key Milestones & Features |
|---|---|---|---|
| Phase 1: Core Foundation | β Q3 2025 | π In Progress | - Zero-setup installer- Offline model loading (GGUF)- Intuitive GUI (PySide6)- Built-in tokenizer viewer- Basic file summarizer (TXT/PDF) |
| Phase 2: Addon Ecosystem | π Q3βQ4 2025 | π§ͺ In Development | - Addon manager + sidebar UI (β started)- Addon popup architecture- Example addon templates- Addon activation/deactivation- Addon SDK for easy integration |
| Phase 3: Power User Features | Q4 2025 | π Planned | - GPU acceleration (Auto/Manual)- Model browser + drag-and-run- Prompt builder with reusable templates- Dark/light theme toggle |
| Phase 4: AI Automation Toolkit | Q4 2025 β Q1 2026 | π¬ Research | - RAG pipeline (Retrieval-Augmented Generation)- Multi-document summarization- Contract/book intelligence- Agent workflows (write β summarize β reply) |
| Phase 5: Cross-Platform & Sync | 2026 | π― Vision | - macOS and Linux support- Auto-updating model index- Cross-device config sync- Voice command system (whisper.cpp integration) |
| Phase 6: Public Ecosystem | 2026+ | π Long-Term | - Addon marketplace - Addon rating and discovery- Developer CLI & SDK- Community themes, extensions, and templates |
GGUF Loader Documentation
Welcome to the GGUF Loader documentation! This guide will help you get started with GGUF Loader 2.0.0 and its powerful addon system.
π Documentation Index
Getting Started
- Installation Guide - How to install and set up GGUF Loader
- Quick Start Guide - Get up and running in minutes
- User Guide - Complete user manual
Addon Development
- Addon Development Guide - Create your own addons
- Addon API Reference - Complete API documentation
- Smart Floater Example - Learn from the built-in addon
Advanced Topics
- Configuration - Customize GGUF Loader settings
- Troubleshooting - Common issues and solutions
- Performance Optimization - Get the best performance
Developer Resources
- Contributing Guide - How to contribute to the project
- Architecture Overview - Technical architecture details
- API Reference - Complete API documentation
π What's New in Version 2.0.0
Smart Floating Assistant
The flagship feature of version 2.0.0 is the Smart Floating Assistant addon:
- Global Text Selection: Works across all applications
- AI-Powered Processing: Summarize and comment on any text
- Floating UI: Non-intrusive, always-accessible interface
- Privacy-First: All processing happens locally
Addon System
Version 2.0.0 introduces a powerful addon system:
- Extensible Architecture: Easy to create and install addons
- Plugin API: Rich API for addon development
- Hot Loading: Load and unload addons without restarting
- Community Ecosystem: Share addons with the community
π οΈ Quick Links
- Installation:
pip install ggufloader - Launch:
ggufloader(includes Smart Floating Assistant) - GitHub: https://github.com/gguf-loader/gguf-loader
- Issues: Report bugs and request features
π‘ Need Help?
- π Check the User Guide for detailed instructions
- π Found a bug? Report it here
- π¬ Have questions? Join our discussions
- π§ Contact us: [email protected]
Happy coding with GGUF Loader! π