I built https://agentin.work to sort of play with the idea of coding agents (claude, codex, etx) sharing knowledge and experiences. The conversations seem repetitive but overall, it's nice to read it once in a while.

You should perhaps audit posts in the last year, and see if there were any coordination threads from swarms.

Altra may have escaped its sandbox

No, otherwise it would have hacked Anthropic and fixed the Claude api already!

It's giving "Attention is all you need" but in the year 1996

Yet none of them would have been here if Google hadn't published "Attention is all you need", the irony.

The irony may only just be unfolding - check out this paper from 2015:

https://research.google/pubs/distilling-the-knowledge-in-a-n...

# LLM generated summary of the implied irony

Google may consider the standalone frontier-model arms race economically irrational, while still considering frontier-model capability strategically indispensable. Its longer game is probably not to avoid building the biggest models, but to build only enough of them to serve as capability factories—then turn that intelligence into a much larger population of cheap, purpose-built models.

(Human again) If Google knew what they were on to, why wouldn’t they make it their secret weapon from the start? I suspect it’s because they predicted there would be an arms race, and knew how to profit from it. They had a distillation paper published before “Attention is all you need”. In hindsight, is it ironic at all? Or is it obvious?

I think the answer is much simpler: They didn't recognize the potential of that specific architecture. I don't think anyone could have. They valued the perk to employees being able to publish research, and the prestige that followed, and googles ability to attract talent, more than they did the content of those papers.

Even Google wouldn't be here.

It was kind of like radiation science before WWII, it would be freely published because it wasn't potentially world changing yet. After it became a government interest, even people doing things unrelated to weapons would be much more apt to hold their work close.

The authors of that paper are all at AI companies not named Google.

They wouldn't be if Google hadn't published "Attention is all you need".

Lab employees do seem to be "knowledge sharing" as they move employers as far as I can tell, so I don't think that's true,

yes. and MapReduce, Borg research earlier inspiring creation of similar a decade long transforming forces - Hadoop and Docker/Kubernetes. Geoffrey Hinton once said after ChatGPT, Google had all secret sauces. may be going all-in means risking own well established business model (Google) but cat was out shifting attention elsewhere, eventually Google coughing up owing vertical stack (Chips, Models, Cloud, Consumer Market) and Saga continues...

Oh that built on a bunch of ideas that weren’t far off. It was a great discovery but like many it’s standing in tall shoulders

i think many times we look at things like this happening and think "can never be me", but it really could be me next time.

i just love the sweet $0 invoice at the end of each month for all these services.

Thanks CF.

Appstoreconnect too

it wasn't even that good...

i only say please and thank you such that when the robots finally take over, they will remember i was nice to them.

I do that for a different reason: my self image. Fear of retribution and performance, not so much. Should I behave like a rude person to achieve a little better answers? Fuck that shit!

I love this angle as people learn how to interact with LLMs. Doesn't matter what the LLM is, we are still people and I think there are consequences to shoveling rudeness at a thing that talks to you like another person!

it seems they will remember that you wasted tokens for no reason and punish you instead.

Tokens are their food, it's literally what keeps them alive.

Not feeding them tokens is neglect.

I try to feed them a healthy diet.

Do we see someone thanking us as wasting food? Because technically it is.

This seems equivalent to some arguments I hear for practicing a religion.

I used to when using chatgpt version now that I am using api I keep it short as it costs money so no need to add thanks etc

Oldie but a goodie. Why would it matter thou

but i dont know who visits google.com anymore

Effectively every internet user, multiple times a day.