Sparsity in LLM
#Day4 of Being an Imposter 😛 Sparsity in #LLMs refers to the fraction of parameters that are active during an […]
Blog, Study Room
Blog
PLE – Per Layer Embedding in LLMs
Day 3 of Being an imposter 😛 PLE (Per Layer Embedding) is a surprisingly similar approach to MoE,Instead of doing
Blog
MoE – Mixture of Experts in LLMs
Day 2 of Being an imposter 😛 MoE (Mixture of Experts) was a leap beyond thought, that is now being
Blog, Study Room
RoPE in LLM
Day 1 of being an imposter 😛 RoPE (Rotary Positional Embedding) is crazy good way to reduce the dimensional space,
Blog
Laptop Repaste PTM7950 Real Experience
A Stripped Screw, a Frozen Pad, and 7+ Hours — My Laptop Thermal Repaste Saga A stripped screw held my