He even cites the reasons for that over engineering in the post you've linked?

Also, even before reading the comments, I was pleasantly surprised that everything on that page worked and nothing bothered me. There is a good amount of attention to detail (switching of the rounding on codeblocks when switching to light mode for example, avoiding a weird corner on mobile). Nothing moves around on load etc. I know this is a low bar, but it's gotten pretty rare, even for pages linked on here.

I'm trying to say that his 100k lines might actually be spent on attention to detail and aren't just slop.

Fyi, if you're trying to run this under AMD/HIP:

PTQ1_0 has no optimized MMQ-Path in their llama-cpp fork, try running PTQ2_0 (needs a bit more vram, but is about 2x faster on my 6700 XT)

https://gist.github.com/nilsherzig/b8266d001c5c01bdb3d81d209...

what kinda speeds do you see on 6700 XT? i'm always conflicted on investing time chasing speed-vs-quality tradeoffs. I've got a 7900 XT (about double the IO throughput). I'll probably end up giving it a go when I find time.

Please explain what you mean by "AI assisted usefull content is always fine".

Here is a detailed explanation from Pangram how their scoring works https://www.pangram.com/research/how-it-works

Thanks for the report.

the website of this company is using more resources than their main product is (would really appreciate a button to turn of the animation)

There you go :) https://hnslop.nilsherzig.com/

as an extension so you can continue to comment and use hn as usual

Almost no programming-related posts left after filtering. Nice!

"Made with <3 by ..." Yea it is

I did this on purpose, I do not think AI would leave that in lol

yea fair, probably not

If a Userscript solution is fine for you, see my recent comments :)

added a firefox extension :)

Here is an approach to filtering LLM written content: https://hnslop.nilsherzig.com/

Instead of filtering keywords this ranks the content using Pangram. But it's also pretty effective at filtering content about AI. Turns out that a lot of LLM tooling projects have LLM written project descriptions/blog posts.

It's amazing to see how many of the "AI hurts my brain" posts are apparently written by an LLM.

nvm sorry, just read the "how this works" comment from OP. https://news.ycombinator.com/item?id=49660301

OPs solution does more than keyword filtering. But its still about filtering out "content about ai" not filtering out "ai written content".

Great point. I think the key is differentiating between "prompt generated" content vs "AI as a Topic" content and then being able to toggle them at will.

I am not averse to prompt-generated content, but it should be marked and quoted as such, just like any other reference. If it's not, it's like the author is double-cheating.

In fact there are no shortage of comments here on HN, especially open-ended questions that could've been plugged into a bot for an answer. Avoiding LLMs altogether is foolhardy. It's a matter of balance, and being able to write a good prompt is a skill - no mental atrophy there. Content derived from non-English sources using English-based LLMs is also an interesting area. [1]

It's possible to obtain AIaaT from https://aibriefs.news/ and then prune it elsewhere if need be. But the best aggregators like that may be machine-generated with a lot of human moderation. I wonder if that is 100% machine generated.

Likewise, HN-AI could well be a decent site.

[1] How much content can be derived from non-English sources using LLMs? https://share.gemini.google/ObjMQHCj8JWj"

Nice! I was considering doing this but the Pangram API is very expensive. Then I considered training my own model and I fortunately stopped at the edge of that rabbit hole.

Yea very expensive (hence me siphoning another page haha).

Im trying to get something cheaper to work, Pangram has some nice docs on how to build something like their service https://github.com/pangramlabs/EditLens, they even have training data online.

The harm a missclassification carries is much lower for a hn post than a masters thesis, so we might be fine with a worse model.

Yeah agree, Pangram puts out interesting material. I recently came across their v4 technical report and they shared a lot more than I would have expected them to.

But see, here I am back at the edge of the rabbit hole, and you're trying to pull me in. I refuse!

If you do end up training a model, send me an email and maybe I can tie it into the site.

Will do, thanks for hcker.news btw, has been my main mobile client for couple of months. Of all things i like the changelog most, its nice to have a quick view about new stuff, especially if the website changes somewhat faster than usual.

Thanks! I always forget to update the changelog for a bunch of stuff. I'm glad you have eyes on it, I'll be more mindful to add to it.

If you really wanted to optimize something involving living consciousness beings like a machine, at least you should consider things like the need to take a piss as a hard constraint and design the system around it.

Don't get me wrong I love factorio like the next guy and understand the idea behind your thinking, but there should be limits to that thinking in the real world. And if that doesn't convince you consider the efficiency loss of a depressed worker with a urinary tract infection.

Honestly - and I don't mean that as an insult - I hope for you to experience (just once) the loss of dignity that not being able to visit the restroom on your own decision will give you. Might make you realize the hell this kind of thinking leads to.

// Honestly - and I don't mean that as an insult - I hope for you to experience (just once) the loss of dignity that not being able to visit the restroom on your own decision will give you. Might make you realize the hell this kind of thinking leads to.

I am not insulated and I think my post was received stronger than I intended, with my point being simply that there are jobs where physical presence at a given moment is more significant than in knowledge work for example (say whatever you want, bus drivers and others defacto hold it in if possible to avoid disruptions at least here in NYC)

And to be frank even at my job which is very removed from bus driving or warehouse work there are moments where I would feel self-pressure to hold it in short of a dire emergency.

(Eg, I am on stage at a speaker panel or something like that where my absence would be visible and disruptive)

Are you on stage at a speaker panel 8 hours a day, every day? Because in the 8 hours a day case 'just holding' isn't an acceptable requirement.

Not going to discuss this further, but wanted to apologize for my message. I was annoyed and should've waited before sending. Sorry.