You can drop cloud spending by 10x factor and still use Spring Boot comfortably. In startup world exist infra costs benchmarks and they are very generous. That fat does not come from frameworks, it comes from not spending an extra hour on solution design.
> devs nowadays aren't willing to pay for development tooling
I can't speak generally because it varies but is this really the case here? Other posters have commented on missing features and issues with their product i.e. Deno Deploy so is it not willing to pay or not worth it?
> I can do that in a weekend, which is also probably true for Deno anyway
You can build Deno or even Deno deploy in a weekend? Even AI can't (not properly).
1. People say things all the time especially online. They might even tweet about their weekend project YET they might still buy it. Not equivalent.
2. If you have to buy it is usually tied to a business reason e.g. make work better or their business and so there's a lot more to it e.g. safety, regulations, etc.
MOE but 120B range. Man I wish it was an 80B. I have 2 GPUs with 62Gib of usable VRAM. A 4bit 80B gives me some context window, but 120B puts me into system RAM
Looking at and having looked at some of their cloud spend etc, nah.
To be more specific there's a lot of fat. Whether that's HFT style high performance is a different story.
reply