OpenAI GPT 3 Language Models are Few Shot Learners - doraithodla/notes GitHub Wiki

Why AI will not dominate humanity.

• self supervised learning + transformers
• Language only cotains a fraction of human knowledge
• Most of the human knowledge is non-linguistic
• LLMs are simply trained on text
• accumulatng knowledge context
• It is not all about larger models