At what point do you buy a Mac studio or AMD Gorgon Halo and try running some of these tasks in local models? Surely don’t need frontier models for all this work.
You definitely don't need frontier models for all this work.
And, in fact, I got it from £2500 to £150 by careful model selection (I ran a trial over a small dataset with different models until I found the least expensive/capable model that would reliably do what I needed), using a local model for one step, and paring down the inputs as well so the token count plummeted.
Yeah I see the same thing at work. Most of the people burning crazy numbers of tokens aren't doing any amazing work. They're just using fable to write their emails and do their web searches.
They feel like they're super smart but it's just as smart as hiring a $500k/yr PhD as a PA to schedule your meetings and answer the phone. Sure it does a good job but you're just wasting money and abilities.
They feel super edgy and bleeding edge but all they really do differently is switching the AI chat from auto to the most expensive option all the time. When I see what they're using it for they're only grasping the basics of its abilities.
They're also people sending 2 page AI generated emails that make no sense for literally everything where a "Yeah sure let's do that" would have sufficed.
Unfortunately most of these are business leaders who just want to look edgy and "all in on AI" so we can't really limit their tokens. Yet they're also the ones saying we spend too much and want to limit some of our dev teams actually putting it to good use.
Management succumbed to AI psychosis, and so we were directed to show that we were adopting and using AI, but what we were using it for was not considered important. So we went out of our way to burn as many tokens as possible.
If you tell Claude to be inefficient and burn as many tokens as it can, it’ll happily oblige. It will also offer useful advice as to how to use even more tokens.
- Mac Studio M5 Ultra, 80-core GPU, 256GB memory, 2TB storage -- $11,299.00.
- Power (385w continually 100% of month) is $40/mo (my regional) or $480 annually. Let's say power is 3x more expensive in California, which it probably is, that's still only $1,440 annually in power.
The Studio M5 Ultra has a worklife of at least 3 years.
it's going to be quite slower than remote providers, won't be able to run full models, only quantised, and for more cost than the highest Claude subscription tier where you can do roughly 60-100M token per month at 200$, e.g. 7200 for three years. It makes sense if you prioritize local AI but not really otherwise sadly.
You have to be using an incredibly small amount of usage for your math to math here. Go price out a few MW or better site then ask a neo cloud how much that same amount of compute will cost at an API.
Just listened the horrific ATC audio. Why didn't she initiate LearJet's heated wing de-icing? When OAT is around 0C should have been turned on. They were flying in -47C that's ridiculous cold.
Warning. Heard people say on Reddit to NOT listen to that audio.
Yeah will have to wait a year or two to find out the cause.
I'll just say I wonder why they flew in that weather system at all. From watching too many accidents on YT I am guessing with private aviation there is more pressure to get it done.
On flight radar where I live if there is a fraction of the thunder storms the sky is a ghost town and they will delay departures from other airports say 1hr flight away to wait it out.
Read more about this since and I think deicing can only do so much and can be overwhelmes by severe icing perhaps cause by supercooled water (liquid but below zero).
Usually at -47C it is too cold for this to happen but speculators have said this may be supercooled liquid coming up from the lower thunderstorm.
Happy for people to comment if any of this is wrong. I am not a pilot or aircraft engineer or fluid mechanic etc.
My layman's idea of how hard to get rid of ice: try cleaning your freezer of built up ice or chuck a massive block of ice in the sun and see how many hours it takes to melt. Snowmen can survive a sunny few days after the snow.
Anybody recommend a CVE alert self-hosted app? E.G. I specify my software, OS’s, and versions and when a matching CVE is created I get an alert. Don’t want enterprise security products.
I suppose they could play the super long game and deposit many many small amounts into "shady" online crypto casinos, play a few hands of blackjack and then withdraw. Clean coins.
Online casinos AFAIK tend to shuffle the deck after every deal which makes card counting impossible. Then it just becomes like any old casino game where with optimal play the house has a small edge still
There are live dealers with shoes of real cards with most online crypto cainos. Though, who knows if they are cheating somehow. My point was, the attacker doesn't have to bet the entire deposit. Just make it seem like they are playing.
Welcome to the party. Remember during covid if you even questioned the lockdowns, mask effectiveness, vaccines you were shadow blocked or even banned. This is why Elon buying Twitter was such a big deal.
I don't know whether to reply to you or slowin's reply but this is correct. And I tend not to think it was Dorsey's fault. And apparently Musk has indeed made a mess of Twitter but it's also wrong to assume there weren't massive problems with old Twitter too
So where does the implanted chip upload the seed phrase to? Who owns that website? This seems like it should have been caught with wireshark or network sniffing of the Ledger app?
reply