Hacker Newsnew | past | comments | ask | show | jobs | submit | Shakahs's commentslogin

AWS already models all their services with Smithy, the specification language they created. Their API clients are all generated from Smithy, and the emulator seems to have been built using the Smithy specs and comprehensive integration testing against the real APIs. Using the spec ensures they hit every variant and optional field of every endpoint, unlike Floci and Ministack that only implement the more commonly used ones.

https://github.com/aws/api-models-aws

https://github.com/smithy-lang/smithy


Smithy doesn't help when a field is a string type but embeds an entire DSL.


This was Google's big announcement at their last I/O conference: That Google would become the agent handling all forms of commerce on behalf of the average person worldwide.


It’s because LLMs are a threat to Google Shopping too. But as a consumer, why would I want another middleman?


Not familiar with this particular library, but similar libraries use S3 Express One Zone which has write latency <10ms, so you can use that for the WAL and compaction can move data onto other storage classes in the background.

Regular S3 has write latency 100-150ms, which might be fine depending on your workload anyway.


You nailed it! With some of the similar products I've seen, they either inherit the Kafka protocol and hence the KRaft and other complexities, or go the other way with single-node only deployments, commonly just using SlateDB's single-writer model for durability.


Frontier model providers (Anthropic et al.) gate new accounts to impractically low rate limits and spending caps until clients unlock higher limits with cumulative usage, make equivalent cash deposits up front, or talk to a Sales department to work out some other arrangement. They are handicapped by the postpaid billing model.

It's an administrative burden to sign up very every model provider, and there are many independent inference providers now that serve only open source models.

OpenRouter provides a useful service by allowing easy prepaid model access with much higher rate limits, and they also aggregate different model providers to route queries by price, latency, etc.


The full Claude Code system prompts are extracted every update and posted here, all 670 of them.

https://github.com/Piebald-AI/claude-code-system-prompts/tre...


JSON is okay most of the time, but I loath YAML.

How many Kubernetes administration headaches trace back to the need for automated systems to surgically edit YAML? It’s absurd and YAML may be the worst choice for this use case.


Recently I go to learn data ingestion pipelines configured in YAML for ETL purposes in SPARK, instead of plain SQL, oh the pain to debug anything.

Kubernetes makes me miss WebSphere 5, the version is on purpose, before the usability goodies that came up in 6.1.


If you are paying API rates (not using Max subscriptions) there's no reason to use Anthropic's API directly, the same models are hosted by both AWS and Google with better uptime than Anthropic.


How do things like prompt caching etc play into that? Would I theoretically have a more stable harness backing my usage?

Im seriously over the current claude experience. After seemingly fixing my 4.6 usage by disabling adaptive thinking and moving to max effort, it seems that the release of 4.7 has broken that workflow and Im 99% certain that disabling adaptive thinking does nothing even on 4.6 now. Just egregious errors in 2 days this week after coming back from vacation.


AWS Bedrock supports prompt caching, just note that if you use the Converse API you need to set the cache points manually.


> Would I theoretically have a more stable harness backing my usage?

If you don’t mind an opinionated harness that asks for a pretty specific workflow, but one that works well, use OpenCode.

If you want to spread your wings and feel the sweet kiss of freedom, use Pi.


Im looking at moving to Pi and I like the minimal nature, but I disagree with a handful of decisions they make. So Id likely need to maintain a fork which is less than ideal.


What decisions is Mario making that you disagree with? My impression is Pi is minimal so any changes can live on top of Pi without needing to maintain a fork?

I started developing my own coding agent after using Pi for a couple months, so I’m curious what you don’t like about pi.


When I hear Mario talk about pi and his approach I find myself agreeing with a lot of it. But I also find myself agreeing with a lot of the points from this https://www.thevinter.com/blog/bad-vibes-from-pi


the opinions in question are that bash should be enabled by default with no restrictions, that the agent should have access to every file on your machine from the start, and that npm is the only package manager worth supporting. Bold choices.

To save others a click, though the article is worth reading.

He also mentions no subagents by default in pi as well.


oh-my-pi harness fixes many of these, like subagents


It seems to, but then also throws in the kitchen sink and a custom bath.


check out my pi forks.


Ummmmmm, how?


I searched his HackerNews username on Google.

[0] - https://github.com/cartazio/oh-punkin-pi


That (and oh-my-pi) seem like an excessive swing in the other direction. Im all for the simplicity and minimalism of pi. There are just a few fundamental things that need updated (mainly subagent context and open-by-default security model).


yup thats mine. :) i actually had some stuff layered into mono pi, and i frankly hit my limit in terms of architecture issues in monopi, omp aka oh my pi is frankly better architectured. if you pared back the fearure set to be minimal, you would full stop have a better designed minimal harness.

i do have a proper next gen no slop harness in the work.

amusingly , dog fooding existing tools with my improvements layered in, has repeatedly validated my design choices and if anything has reduced my tolerance for the errors that seem to happen in vanilla or first party harnesses


pi for the win, i have my own ai extend it when i want more specific features. vibe coded in 20 minutes shift+tab like claude code to add permission control.


I find it so funny that many of these harnesses sound like black magic and are completely mystical to me. I use Claude Code every day and yet i can't imagine the workflow of Pi. I also don't care to pay API rates just to experiment with them.

Largely though i'm happy with Claude Code w\ IDE integration, so i don't feel the need to migrate. Nonetheless i'm curious.


I have enterprise so its always usage which makes it possible for me. And then the other subs I can toggle between which is awesome.

I live in the terminal. Before AI I always preferred it so it suits me


you can use claude code with these other providers



Enterprise adds IAM, logging, and analytics, all of which AWS provides for free or for metered usage without needing an enterprise plan.


They'll cut you a private offer for bedrock tokens but bedrock has a 32k output limit


I use bedrock with 1M context every day. Not sure this is right


4.7 is the first opus model that’s had the 1 M context window available on Bedrock.


Not true. Opus and Sonnet 4.6 support 1m context on Bedrock.


I've had Opus 4.6 1M and Sonnet 4.6 1M for months now on Bedrock.


Their docs may be lying but they say 200k for opus 4.6. And yes 1M was on sonnet for Claude enterprise.


isnt that an input limit from api gateway?


Looks very neat.

You may want to optimize the content serving a bit, since it's currently hotlinking multiple large (30MB) videos at 2K resolution from https://svs.gsfc.nasa.gov.


Yes, you're right about optimization, this what I'll do: - Switch default to 1024p instead of 2048p so file drops from ~30 MB → ~8 MB (4× smaller) - Proxy through existing Cloudflare Worker with edge cache - Add a /video/* route that fetches NASA URL once, caches at the edge - After 1st request per region, every subsequent visitor gets it from Cloudflare PoP

= NASA bandwidth: ~50 hits/day instead of ~10,000! NASA load drops by ~99%


This looks suspicisly like LLM answer


Half of it was a to-do list from an LLM response, Claude Opus 4.7, also why it was updated so fast :D


Update: Updated! Optimizations implemented, thanks for the feedback!


AWS and GCP both have their own custom inference chips, so a better example for hosting Opus on commodity hardware would be Digital Ocean.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: