https://arshnoorsinghsohi.com/blog Writing on AI systems, data engineering, and building things. en-us https://arshnoorsinghsohi.com/blog/transformer-positional-encoding-explained https://arshnoorsinghsohi.com/blog/transformer-positional-encoding-explained Sun, 09 Aug 2026 00:00:00 GMT Transformers read every word in a sentence at the same instant, so how do they know word order? We build positional encoding from scratch — vectors, sine waves, and a beautiful rotation trick — explaining every single term along the way, with diagrams at every step.