I knew close to nothing about JEPA before reading your post, but i was under the impression this was supposed to be a contender for LLM's limitations, a way to do things "properly".
However, based on this article, i have the feeling that on the contrary, JEPA is filling a super niche problem, and is pretty much only trying to improve robotic motions in space.
Which of the two ideas is it ? Can JEPA technics be applied to a much more wide range of problems ? (like LLM and transformers)
JEPA can be applied to text as well in the sense you can use it to build text embedding models, freeze your JEPA text embedder, then train a decoder over the top of that.
OF course your decoder model could end up doing a lot of the heavy lifting if your decoder loss was based on text reconstruction methods (which almost all LLMs use for eval purposes)
For certain tasks, you do need pixel/token level reconstruction fidelity to do a lot of things. Like image generation or text generation.
For other tasks, having a coherent representation of the world that can be computed quickly and intuitively is more salient. I suspect the human mind works more like JEPA than like an autoregressive LLM. Human children train on far less data to achieve extreme fidelity on a lot of tasks generative reconstruction loss based AI/ML techniques struggle with.
While normally making jokes after a person's death would be socially questionable, in this case Chuck Norris himself loved the Chuck Norris jokes. For me at least, a good sense of humor is maybe the most endearing personality trait. RIP
Fundamentally, I'd argue that very little should ever be unreasonable or out of bounds to make jokes about; what is important is that it's good humour.
> Fundamentally, I'd argue that very little should ever be unreasonable or out of bounds to make jokes about; what is important is that it's good humour.
On a personal level, I couldn't agree more. I do hope that culturally we get to that point at some time :-)
I mean, jokes are made to uplift, intent in joking is important and punching up is preferable to punching down, this being said this didn't apply to chuck Norris that would have already got to the punchline without throwing a single fist.
reddit is home to the kind of people (of both sexes) who are highly unlikely to find (or keep) a partner. the only terminally online person I know IRL is being largely ghosted even by his oldest friends.
You are obviously wrong, but that's not the issue here. One can't help wondering what prompted you to say such an unkind thing in the extreme about 1.2 billion monthly active users. On second thought, no need to answer that here. It's the kind of food for thought that is best left undebated.
Created by R74N, not Neal. Has been live on http://sandboxels.r74n.com as an independent project for several years. Just now hosted by Neal. Important distinction.
it doesn't answer the first question I have, which is basically "why". not in any sort of hostile sense, just that it would be very interesting to hear the back story behind this move.
Idverafaliurbehf
Iuhefhd
Deb
Wiufhuisdh
Cubs I h
Acdibdci
SubuDVLBDCUbsduclbsudbcuisDbcilsdbcuibcluisdabcbslcas
ScasejkckbS
Echoiseieohcewoicosei
hcaecho
Eh
E
ChoeiScoh
ascetic
Insouciant
back
Cal
Echo
Ea
reply