05a3 GPT3 - cccbook/py2gpt GitHub Wiki

The Journey of Open AI GPT models

Open AI built the GPT-3 model with 175 billion parameters.

Due to large number of parameters and extensive dataset GPT-3 has been trained on, it performs well on downstream NLP tasks in zero-shot and few-shot setting