How LLMs Actually Work

LLM Application Development

TODO

How LLMs Actually Work

• text -> tokenizer -> embedding lookup -> transformer -> unembedding -> softmax -> next token

• Tokenization

TODO

• Embeddings

• Positional encoding

• Attention

• feed-forward network

• next-token prediction

reference

• [How LLMs Actually Work](https://www.0xkato.xyz/how-llms-actually-work/)
• [LLM Application Development With Python](https://realpython.com/learning-paths/llm-application-development-python/?utm_source=realpython&utm_medium=web&utm_campaign=related-learning-path&utm_content=python-mcp-client)
• [Hands-on Large Language Models: Language Understanding and Generation]