wshine ai hw7 - TheEvergreenStateCollege/upper-division-cs-23-24 GitHub Wiki
- the vector on the right is a one-hot encoding of the vector on the left one hot encoding is turning data into a form that can be used in mathematical operations for examples words to numbers. In this case it is a one hot encoding of numbers to their binary representation.
- an input (x) and an expected output (y). these pairs are used to train the network.
- A -> 2
B -> 1
C -> 3
- 7x128
- 8x12
- index 4. option 2 is true, this image is showing the embeddings created from 7 token ids and the embedding output dimension is 4