And it gets justified by using the argument that “if we don’t do it, the competition will, and they’ll win”. So now we can’t even relax and let the AI take over and move up a level in abstraction - we also have to stress out about “using AI to the fullest”. And what does that even mean?
The closest to "HN lite" is probably lobste.rs. There's a fair amount of overlap, but it's closer to 20% AI than 80% AI.
Reddit? General-interest subreddits such as /r/technology are mostly mainstream news, but there's plenty of specialized ones, such as /r/math, /r/programming, /r/c_programming, /r/rust, etc. Most of these have relatively little AI, some explicitly contain all AI content to weekly threads.
Many of the aggregators "killed" by HN are still alive, just not as popular. For example, boingboing.net is up and running. Also, places like Ars Technica have RSS feeds, so it's easy to construct your own, you just lose the social aspect.
Huh, I’m surprised R. Talsorian Games doesn’t also have a trademark. Wonder if they sold it to CDPR under the condition that they’re still allowed to use it for their products. Also, apparently a company in Shenzen holds the trademark in relation to lighting products, so you probably won’t see any 2077 branded lamps any time soon
I heard a rumor (on instagram, so YMMV) that the professor who was closest to solving this problem had only weeks ago used Codex, which had slurped up all his notes on the subject. Now OpenAI's agents solve the problem. If it's true that seems like quite a coincidence.
See, e.g., Barak Ravid regularly reporting in Axios the impending ceasefire negotiation progress in the Iran War, which largely have failed to come to pass.
I won't take a side in things, but OpenAI stated the model they used here started training August 28th. Note that "training" here might mean "post-training with RLHF an Astra base model" or something. but training had only started a little over a week earlier.
IMO It’s not about being trained on the data, it’s more like what do the agents have access to during inference? Can they grep customer transcripts/logs?
Has it not been the usual process to snapshot a model to use for inference while continuing to run the training process? I guess you can’t add to the training corpus once you begin? Just trying to make sense of whether training begins or ends as rigidly as you suggest.
No, it's quite well defined, and it's not called a 'memory subsystem'. There is a training process (as in traditional Machine Learning training) that occurs with data available at the specific point in time the training starts (or ends), this is called the cutoff date.
After this point there can be other kinds of training, the weights can be shifted, the internal CoT prompts can be changed, routing in MoE can change, but the Foundational Model that was trained on a corpus is the same model trained in the same corpus.
User data can be used at any of these stages theoretically of course, but by the nature of training and from the dates of the events, (a new Foundational Model being released), it would look as if the user data of the professor was used in the training of the foundational model, which is something that OAI does every couple of months for a big release, and incorporates the new text from their text scraping efforts, including new books ingested, new internet text scraped, deals with third party platforms, and data from their own users (not conjectured, read the ToS, users allow this.)
There have been several threads and developments on this over the past few days, including statements from the primary subjects involved. Third-hand instagram comments are not really the best source to be bringing in.
Everybody comes into information in different ways. There were no comments here about this specific aspect of the story - which is definitely interesting!
Location: Nelson, New Zealand
Remote: Yes
Willing to relocate: No
Technologies: Rust, graphics via `wgpu`, WebGPU, frontend, backend, retail, AI inference on edge, Zcash crypto experience (with no desire to continue in crypto)
Resume: https://zyghost.com/resume.html
Email: [email protected]
GitHub: https://github.com/schell
I'm a generalist that has worked in many domains, with 20+ years of experience. I'm looking to get out of crypto. Senior or Staff level Engineering (IC) is a good fit.
Came here to say exactly this. If you’re not writing the code (or especially reviewing it) then we need stronger type systems and more checks and fewer legal programs. Might as well move all the way to Idris or some not-yet-invented language that humans would find very restrictive.
reply