Cost function - AshokBhat/ml GitHub Wiki
Description
- Interchangeably used with loss function. However, the two have a slight difference.
Loss vs Cost function
- Loss function - For a single training example
- Cost function - Over the entire training set (or mini-batch for mini-batch gradient descent).
| Loss function | Cost function | |
|---|---|---|
| What does it apply to ? | Single training example | Entire training set (or Mini-batch) |
| How often is it calculated? | Many times | Once |