Depending on the finetuning tool you're using, you can just start the training run, and then it shows you how long it'll take. Like give it 5 mins to stabilise, then see the estimated duration.

Axolotl is a good finetuning tool if you need one.

I really wish people developing local applications would allow users to specify an API endpoint. Most applications use an OpenAI compatible API, and if they don't the browser's implementation of local model inference can be used.

I've also been looking for an "LLM browsers" for iOS, i.e. apps which can work with LLM endpoints that I host, but I haven't been able to find anything.

Distil-whisper is incredibly fast. Realtime on a 3060 Ti, and I used it to transcribe an 11 hour audiobook in 9 minutes.

You know, those audiobooks already have transcriptions. Often written by the original author!

I kid. Your comment made me think of a shower thought I had recently where I wished my audiobook had subtitles.

It really is a little absurd IMO that the text of the book is sold separately from the audio.

Book publishing industry is different from audio recording industry.

Current SOTA open source is I believe SUPIR (Example - https://replicate.com/p/okgiybdbnlcpu23suvqq6lufze), but it needs a lot of VRAM, or you can run it through replicate, or here's the repo (https://github.com/Fanghua-Yu/SUPIR)

Anyone see the stonks image hidden quite well behind the first table?

I could only see it because of my dark mode extension, otherwise I guarantee I wouldn't have caught it.

Assumedly by scraping it into a raw text corpus format, and feeding it to a model like LLaMA-2.

For those of you who haven't read to the end of the README, its for procrastination. The idea is that if you, as a part of your work, read a lot of papers, but want to procrastinate secretly, you can convert a book or website you'd like to read to a paper, and thus it seems as if you're doing your work but instead you're enjoying your book.

So, it is alike PhD Comics emergency button (see the bottom right corner of https://phdcomics.com/comics/).

Ah so this is what PhDs actually do!

In my experience, PhD students procrastinate _a lot_.

Can you provide some of these sources?

All of these should have close ties with OpenAI, but no one from inside confirmed it as far as I know.

https://twitter.com/swyx/status/1671272883379908608 https://twitter.com/soumithchintala/status/16712671501017210... https://twitter.com/MParakhin/status/1670666605427298304