PaLM - AshokBhat/ml GitHub Wiki

About

• PaLM (Pathways Language Model)
• Dense decoder-only Transformer model
• 540 billion parameters.
• Demonstrated state-of-the-art few-shot performance on most tasks.
• By Google in April 2022

Performance

See also

• https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html
• [LLaMA]] ](/AshokBhat/ml/wiki/[[GPT)