Attention is a weighted sum over positions already computed

The whole file is pasted into the window. The important function sits in the middle, and the answer acts as if it never saw it. The token is still there. This layer's weight on it can get near 0. Three rows of vectors compute a scaled dot-product. The causal mask clears future positions to 0. This note does not train.