LLM - gusenov/kb GitHub Wiki

  • Cake is a Rust framework for distributed inference of large models like LLama3 based on Candle.