Blog

Refresher on how LoRA works

quantization

LLMs

transformers

exploring how LoRA enable efficient finetuning

Simplicity of Byte Pair Encoding

Tokenization

LLMs

transformers

Understanding the functionality of Byte Pair Encoding and implementing it from scratch in C

Wrapping your head around Self-Attention, Multi-head Attention

Transformers

LLMs

Fundamentals essential to understand the phenomenon named “Transformer”