Petals Integrations - bigscience-workshop/petals GitHub Wiki

🔗 Langchain: Building applications with LLMs through composability.

Docs for Petals integration: https://python.langchain.com/docs/integrations/llms/petals_example

🚅 LiteLLM: Call all LLM APIs using the OpenAI format.

Docs for Petals integration: https://docs.litellm.ai/docs/providers/petals

🐛 InSeq: Pytorch-based hackable toolkit to democratize the access to common post-hoc interpretability analyses of sequence generation models.

Tutorial on attributing distributed LLMs with Petals: https://inseq.readthedocs.io/en/latest/examples/petals.html

💬 ChatGPT-web UI by @niek.