1.3.1. Other Potential Components - SamuraiBarbi/jttw-ai GitHub Wiki
AI Memory
AI Assistants
AI Application Builders
AI Single Agent
AI Multiple Agents
AI Machine Vision
AI Coders
AI Servers
AI Benchmarking/Evaluation
AI Proxies
AI API
AI Text to Speech
AI Distributed Inference
AI Generative Image/Video Creation
-
Comprehensive Resource
-
Additional Resources:
AI RAG - Chat With Documents
-
PrivateGPT could be used to ingest documents and query the language model about information from those documents
- Documentation
- Demo 1
- Thoughts: I’ve gotten this working on Linux. Installation is somewhat fussy. Feeding it my 1080 ti 11GB it seemed to take a reasonable amount of time to ingest, and embed documents. I feed it a text document containing erotic fiction to test the models censor sensitivity and if it’s able to summarize the document, tell me specific details about characters, what it considers the last sentence of the document to be, and a number of other inquiries. Its answers were half right. I then fed it a short story of roughly 2930 words and questioned it about characters, and aspects of the story. It would describe characters in broad terms, and exhibited issues correctly identifying how the story ended despite being able to identify the last sentence of the story. Ultimately tests using a short story in .txt format were disappointing.
-
LocalGPT could be used to ingest documents and query the language model about information from those documents
- Documentation
- Demo 1, Demo 2
- Thoughts: I’ve gotten this working on Linux. Installation is somewhat fussy. Feeding it my 1080 ti 11GB it seemed to take a reasonable amount of time to ingest, and embed documents. I feed it a text document containing erotic fiction to test the models censor sensitivity and if it’s able to summarize the document, tell me specific details about characters, what it considers the last sentence of the document to be, and a number of other inquiries. Its answers were more correct than PrivateGPT. I then fed it a short story of roughly 2930 words and questioned it about characters, and aspects of the story. It would describe characters in broad terms, and exhibited issues correctly identifying how the story ended despite being able to identify the last sentence of the story. Ultimately tests using a short story in .txt format were disappointing.