OK everybody is talking about deepseek and I wanted to see for myself.
I am following the note from Xihan Li.
Specs of my desktop.
- CPU(
free -h): 128G - GPU(
lspci | grep -i vga): two RTX A4500, each has 20 GB of GDDR6 memory.
I guess I will try the smallest one (1.58-bit, 131GB).