Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
segmondy
43 days ago
|
parent
|
context
|
favorite
| on:
GLM-5.2 – How to Run Locally
You can run it today with that 12gb vram 3060, but I would suggest getting 2 3090s. Use cmoe option. This will keep the attention/route tensors on the GPU and offload the rest to system memory. Try it now and see the performance.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: