My understanding is that the hallucination is, out of all the possibilities, the most probable one (ignoring temperature). So the hallucination is the most probable sequence of tokens at that point. The model may be able to predict an "I don't have that information" given the right context. But ensuring that in general is an open question.

Great piece!

Thanks!

Hi, would you recommend this book in 2024?

FWIW, most of my recent knowledge on this topic comes from [0].

The programming-language-specific parts are more focused on C than C++ (which is my main focus), but I've still found it quite helpful.

I haven't looked at the other sources people are mentioning though, so no idea how it compares.

[0] https://cdn.kernel.org/pub/linux/kernel/people/paulmck/perfb...

Thank you, I will give your resource a read :)

You're welcome! But it's not a quick read.

At least for me, it requires (a) a good reason for powering through it, (b) a good night's sleep, and (c) Adderall :)

Just saying, it may not be the most effective / efficient way to learn what you want to know.

Ahaha, luckily /s I am a bit of a weirdo and I like to delve deeper into things related to my job.

I was taught that a deeper understanding leads to better software/solutions and I strive to live up to my mentor dedication :)

> I was taught that a deeper understanding leads to better software/solutions

aside from being fun, it just makes everything so much easier when it's not "magic"

Yes