Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
hedgehog
19 days ago
|
parent
|
context
|
favorite
| on:
Notes on gotchas while migrating 35kb preprompts f...
128GB on a Ryzen 395 is enough but not by a lot. Around 90GB for weights plus 10GB to 20GB for KV cache and checkpoints. I don't know about 64GB of VRAM for less than around $2500 by itself.
bitexploder
19 days ago
[–]
Tesla V100? Would have to be a 3-ish bit quant in 64GB ram
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
