The reality is that we are hitting a plateau that’s taking us as far as transformer architecture will allow us. Until another breakthrough happens, I heavily doubt we’re on the cusp of anything, instead it’s clear that things are levelling out.
I think this continued anthropomorphism "Have you tried asking about..." is a real problem.
I get it. It quacks like a duck, so seems like if you feed it peas it should get bigger ". But it's not a duck.
There's a distinction between "I need to tell my LLM friend what I want" and "I need to adjust the context for my statistical LLM tool and provide guardrails in the form of linting etc".
It's not that adding prose description doesn't shift the context - but it assume a wrong model about what is going on, that I think is ultimately limiting.
> Once in a blue moon is fine but at that frequency? Sounds like you’re just short circuiting your brain and enjoying the sprays while they last.
Actually, the first time I used LSD that was partly the goal; I was trying to find some way to break my brain or otherwise manufacture some brand of insanity. For me though, it turned out not to be particularly capable of that on its own, or at least it doesn't seem to trigger that to happen. It did do something else that I ended up still liking, and that something else is what I use it for nowadays.
reply