https://llmsresearch.github.io/llm-flashcards/card/what-is-tokenization
you're welcome btw
A club for red-pilled exiles.
