Questions Toolformer - ufal/NPFL095 GitHub Wiki

  1. Why might we want a LLM to call upon external systems? What is the benefit of having a LLM learn to do this in a self-supervised manner?
  2. Where are the <API>...</API> tokens inserted? Before the relevant sentence or before the relevant phrase? In the latter case, how are the phrase boundaries decided?
  3. Annotate the following 4 examples with API calls of the 5 external tools mentioned in the paper:
    • The capital city of Prague has 1,365,600 inhabitants. That is 12.6% of the total national population of 10,850,620.
    • The professor has office hours on Monday to Wednesday, so tomorrow they won't be in.
    • Joe Biden was born in Scranton.
    • Joe Biden was born on November 20, 1942, i.e. 81 years ago.
  4. What are the limitations of the approach taken in this paper?
  5. Bonus: Can you think of any other APIs that may be useful for a LLM to call upon, or extensions to these APIs, beyond what the paper has mentioned?
⚠️ **GitHub.com Fallback** ⚠️