Hacker Newsnew | past | comments | ask | show | jobs | submit | DwarvenEngineer's commentslogin

That's entirely why Zuck's been pushing VR and the metaverse for so long. they have no OS to control - Microsoft has desktop, Apple has their vertically integrated devices, Google has both Android and also Chrome.

Meta is at the whims of these other companies to play nice - and they already got hit hard once by apple when they decided to anonimize add profiles on the iphone and go privacy first.


Okay, so I've heard Apple "prioritized their own ads". If there's meat behind that - cool (and perhaps might not do anything about certain scummy listings on the app store)

But app stores and iOS ostensibly exist exactly so Zuckerberg can't do what he does, which is steal credentials. Facebook syncs everything, bought Whatsapp to do the same; of course he's pissed off his ill-gotten moat got attacked


iOS can stop applications from stealing credentials without relying on the App Store. macOS does it, Apple should be encouraged to secure the iOS runtime more than the iOS store.


wdym? Honda's hyrid technology is very different from what Toyota has architecturally


does that mean they're measuring bandwidth differently than how others (like nvidia) does it? memory bandwidth is the gating factor of running models locally, so if it's actually 8x 150GB/s, it may help something like prefill, but would it actually speed up decode comparatively?


No, they use the same definition of memory bandwidth as others, but Apple Silicon has a lot of memory channels. In previous generations, prefill has been compute-limited and decode is fast.

https://blog.exolabs.net/nvidia-dgx-spark/ outlines a combination of a DGX Spark and an M3 Ultra that took advantage of fast prefill on the Nvidia hardware and fast decode on Apple Silicon.


Ironically for home-lab users (ie those who primarily have access to consumer hardware), apple silicon is probably the best value (and also the most obtainable for running some of the smaller sized models. You can get unified memory of up to 192 GB in the mac studios. The equivalent for the "open market" is probably AMD's halo strix which offers up to 128GB unified memory, and the speed of the memory is much slower.

I guess the Nvidia Jetson AGX Thor also exists, but good luck getting your hands on that... and regardless that's also 128GB.

Put it this way, with 192 GB VRAM you can run deepseekv4... with 128gb only with lots of quantization

Edit: WTH! I was curious and i went to apple's website to price out a high end unit just to price comparison, and it looks like the high ram units are gone now, and they max out at 96GB?? Guess i missed that...


Not supporting FP8 is a pain in the butt though. It feels like there are more compromises using Apple Silicon than just going with nVidia and CUDA.


Honestly, I just hate the term "physical AI". They're robots. It's unfortunate that we had to adopt a term with the words AI in it, just to get investor's attention.


yeah, i'd say so. what if lyft's lidar manufacturers said that they should be included in this release because it's their lidars? I agree, it doesnt really need mentioning


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: