This has long been my favourite counter-argument to the 'singularity'. How often in your own life is intelligence the limiting factor? I'd say frustratingly rare. If only! One reason I play games is that it's fun to briefly enter a scenario where intelligence is everything.
I have a Focusrite Saffire that has lots of nice, quiet preamps and ADC channels. I managed to get an old Mac to connect over FireWire and using the Focusrite Control app, I configured the routing to map all the analog inputs to ADAT. That works great but it's always at the wrong sample rate, and I can't change that without getting the old Mac out. Maybe I'll look into one of these rPi shields too. Anyone got any reverse engineering tips for the control protocol?!
The control protocol might be MIDI Sysex .. once you get Linux wired up to your FireWire interface you can wireguard the interfaces and see if you recognize SYSEX packets ..
I've been wondering for a while if a program could "learn" covariance somehow. Through real-world usage.
Otherwise, it feels to me that it'd be consistently wrong to model the variables as independent. And any program of notable size is gonna be far too big to consider correlations between all the variables.
As for how one might do the learning, I don't know yet!
Unfortunately 100 queries per day is quite low for LLMs, which tend to average 5-10 searches per prompt in my experience. And paying for the search API doesn’t seem to be worth it compared to something like a ChatGPT subscription.
> Custom Search JSON API provides 100 search queries per day for free. If you need more, you may sign up for billing in the API Console. Additional requests cost $5 per 1000 queries, up to 10k queries per day.
What I meant is that pricing for 10k queries per day does not make sense instead of a simple $20/month ChatGPT subscription.
If you actually did 10k queries a day with any free search service you'd quickly find yourself banned.
ChatGPT deep research does a lot of searches, but it's also heavily rate-limited even on paid accounts.
Building a search index, running a lot of servers, storing and querying all that data costs money. Even a cheap search API is gonna cost a bit for 10k queries if the results are any good.
Kagi charges me 15 USD and last month I've done 863 searches with it, more than worth it for the result quality. For me the Google API would be cheaper. I'm pretty sure Kagi would kick me out if I did 10k searches a day even if I'm paying for "unlimited searches".
A similar API from Bing costs between 15-25 USD for 1000 searches. Exa.ai costs 5 dollars for 1000 searches, and it goes up to 25 dollars if you want more than 25 results for your query.
Pretty fascinating from an information theory point of view. Surprising that it works at all. Is this, like, the JPEG of uniformly distributed, uncorrelated data?
We don't know. They basically look for sequences that approximate NN weights well, in the same way sinusoidal functions work well with "natural" images, but not with graphics with hard edges.
reply