Why might we want a LLM to call upon external systems? What is the benefit of having a LLM learn to do this in a self-supervised manner?
Where are the <API>...</API> tokens inserted? Before the relevant sentence or before the relevant phrase? In the latter case, how are the phrase boundaries decided?
Annotate the following 4 examples with API calls of the 5 external tools mentioned in the paper:
The capital city of Prague has 1,365,600 inhabitants. That is 12.6% of the total national population of 10,850,620.
The professor has office hours on Monday to Wednesday, so tomorrow they won't be in.
Joe Biden was born in Scranton.
Joe Biden was born on November 20, 1942, i.e. 81 years ago.
What are the limitations of the approach taken in this paper?
Bonus: Can you think of any other APIs that may be useful for a LLM to call upon, or extensions to these APIs, beyond what the paper has mentioned?