this machine just keeps getting better and better in the inference world. the memory bandwidth is too good, newer macbook pros aren't that much faster in memory bandwidth, many are slower. not enough to upgrade yet as they're mostly horizontal upgrades, the improvements in other areas are adding up like wifi bandwidth and protocol, NVMe speeds, webcam
if they do the M7 correctly: which is just everything their current models do plus way faster memory bandwidth and much greater memory possible 192GB+, then it will be a really great and timely upgrade
Here are the numbers that got me buying a used M1 Max for LLM work.
M1 Max 400GB/s
M4 Pro 273GB/s
M5 Pro 307GB/s
Only Max are worthwhile for LLMs. An Ultra is just two Mac chips on a die, but I think they're just used in Mac Studio.
I'll check it that inference engine! Thanks!
Edit: it doesn't give numbers for unsloth/Qwen-3.6-35B-A3B 4bit, but I'm using mlx-serve right now and getting petty good numbers (and it took a while to tweak everything properly!)
no it’s stuck there, M1 has a 720p cam with a smaller sensor thats noticeably bad in low light, and the refresh has occurred twice to 1080p with larger sensor and 12MP but cropped to 1080p for audience tracking
The cam did improve with the M4 but sadly still not as good as a phone. Considering iPhone camera bumps, MacBook displays sadly might not be thick enough for a phone camera.
I'm having kinda the opposite experience, but it's less to do with Linux and more to do with hardware, firmware and manufacturers.
MiniPC network device doesn't have a Linux driver. At all. Had to get a vibe-coded, reverse engineered one. This was a first for me.
NAS (ugreen) was a pain in the ass to install my own OS on (I didn't trust theirs, wanted OpenSUSE, and had to get a reverse engineered LED controller driver so I could display hard drive health)
ASUS Laptop will not sleep properly, and would drain the battery flat in a day or do. Myself & Claude gave up after days of trying various tricks workarounds (up to BIOS hacks). The best I can do is hibernate (after about 5 minutes of sleep) but man, the hacky bullshit required to get there was incredible.
Different laptop sleeps fine but will not, under any circumstances, hibernate. Even though I have all the crazy tricks up my sleeve from the ASUS that won't sleep properly and needs to hibernate. Different hardware, totally different bullshit problems.
And then I recently got an Macbook M1 Max for local LLM hacking and everything just fucking works. I don't like MacOS but the hardware is amazing and the OS just fucking works with it (and I like that).
14 years on macOS, now running Debian on a Framework.
It can be clunky at times but I have no regrets. I’m now toying with the idea of multi-booting with Silverblue or a derivative, and guess what? I actually can do that if I want.
You expect Linux to work on anything you deicde install it on. That is the wrong approach. Get hardware that is well supported, then Linux works well too.
This is the biggest issue I have with headlines "[country] got all of its electricity from [some renewable] today!" when the reality is they rely on some other supply when [some renewable] has zero output.
Like you say, a lot of countries get a pass because a neighbour invested billions and decades building nuclear. Or else they fall back to coal/gas.
It's not clear what your issue is or whether you would prefer that country X used absolutely no renewables whatsoever and derived all their energy needs including transport and electricity from damaging and limited fossil fuels.
You'll find find me near the top, and I've double checked and still not seeing the misleading headline. This thread itself is captioned Solar surpasses nuclear power globally for first time
Perhaps you'd be kind enough to link to which part of this thread gives that context, as you see it.
My mother has a crow (it's lame and very slightly tame). It's the only crow in a huge murder that isn't afraid of her, and the other crows are in absolute awe of it. It's like they don't know how to completely trust a human like it does. The special crow is like a human whisperer.
The fact is, she would feed any of them, but only crow taps on the window, and goes from one window to the next as my mother moves through the kitchen. The others only get the leftovers, but they line up on the fence.
> ... it's lame ... only crow in a huge murder that isn't afraid of her ...
There are a lot of stories about normally human-avoidant animals becoming far less so when their alternatives look grim. I don't think I've ever heard an explanation, beyond simplistic "obvious-logic" ones.
(Yes, crows are smart enough that "obvious-logic" is fairly credible for them.)
I reflashed one of my dongles to the Thread firmware, and fired it up with the OpenThread Border Router app in HA.
Had it join my existing Thread network by sharing the network credentials with HA from my iPhone, so that it would join the same Thread network as on my Apple TV/HomePods. All devices now work as before.
Yeah I am wondering what's actually needed for thread/matter in home assistant. Do you need a sidecar server? Do you need to install addons in Home Assistant? What of my existing Thread / Matter routers (HomePod Minis).
I've tried a couple of times but just gave up because zigbee/zwave work well enough and I'm not sure I'll like where thread/matter end up in a decade.
I've done too many jobs around my house that should have been done by a qualified <whatever> because none of them are interested in a shitty little repair job, or if they are, the quote is astronomical because there's a huge cost overhead of taking a job and getting your shit onsite.
I think it's the latter, and that's why I think using a "normal" non-debug browser is the best idea because it's essentially undetectable. And for the record, you can technically control Chromium using IPC if you feel like adding that feature & fully rebuilding it from scratch.
reply