Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
angoragoats
on Sept 8, 2024
|
parent
|
context
|
favorite
| on:
Serving AI from the Basement – 192GB of VRAM Setup
Yep. The 8x3090 setup should be at least 10 times faster than the Mac.
wkat4242
on Sept 8, 2024
[–]
Yes though for inference memory bandwidth is more important than tflops. Not sure how Apple compares in that regard. The OP does train models too though which is more compute heavy.
angoragoats
on Sept 8, 2024
|
parent
[–]
Each of the 3090s has something like 15% higher memory bandwidth than the whole M2 Ultra system does.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: