Hacker Newsnew | past | comments | ask | show | jobs | submit | bigdict's commentslogin

Was it a controlled study or just correlation?


Huh? Triton inference server and Triton the kernel language are two distinct, very different things… Is this AI-generated?


Just yesterday I was reading through this five year old post on triton by its creator. Triton was their PHD thesis and they coined the name before the inference server was renamed to it… if this is what you are referring to?

Here is the Reddit thread:

https://www.reddit.com/r/MachineLearning/comments/otdpkx/n_i...


> What actually happens: random Internet users spend two seconds skimming, then click their favorite.

> They're not reading carefully. They're not fact-checking, or even trying.

Uhhh, how was that established?


cuz area and power


Area and power are why there was a choice to make. AI data centre demand is why they made this choice specifically.


There's antimony, arsenic, aluminum, selenium…


What's the point of the relu in the loss function? Its inputs are nonnegative anyway.


Let's try to keep things positive.


I wondered the same. Seems like it would just make a V-shaped loss around the zero, but abs has that property already!


RELU would have made it flat below zero ( _/ not \/). Adding the abs first just makes RELU do nothing.


In reality it’s probably not a RELU modern LLMs use GeLU or something more advanced.


Sometimes a cosmic ray might hit the sign bit of the register and flip it to a negative value. So it is useful to pass it through a rectifier to ensure it's never negative, even in this rare case.


Indeed, we should call all idempotent functions twice just in case the first incantation fails to succeed.

In all seriousness, this is not at all how resilience to cosmic interference works in practice, and the probability of any executed instruction or even any other bit being flipped is far greater than the one specific bit you are addressing.


I thought the belt and braces approach was a valuable contribution to AI safety. Better safe than sorry with these troublesome negative numbers!


Well, I guess it's helping to distinguish authors who are doing arithmetic they understand from ones who are copying received incantations around...


"delves"

dashes

an explicit "conclusion" section at the end


Humans do not write conclusions? As someone who went to college, that is a natural way to end a long essay. True mark of higher education would be writing the conclusion at the top.


Exactly, it's a natural way to write a college essay. I've never not cringed reading an article/blog post that is structured that way, it comes across very contrived. I've also noticed that LLMs tend to prefer it, and humans tend to avoid it in general.


For a 500 word blog post, sure it may be a bit much. This article was a decently hefty read, for which the summary callouts are not out of place.


It's called an executive summary in that case, ain't it?


I was thinking an academic Abstract, but sure.


> dashes

I am forever angry that LLMs have ruined em-dashes. They’re a wonderful part of punctuation.


None of which are hard AI tells.


Lisp In Small Pieces


Yep this is the best way into the heart of LISP


Seconded, it's a great book.


Thirded.


Pairs great with the tale of the Death Valley Germans: https://www.otherhand.org/home-page/search-and-rescue/the-hu....


This article really crawled under my skin a decade ago and stayed there. If one likes that feeling, this is a great read. If not, do not read.


Man, it's absolutely the same for me. Thinking of it, I should go re-read it now.


I get a 401 error with that link, but when I visit it from a search engine it's fine. I think they may have blocked referrals from HN, so if you see that message, try copying-and-pasting the URL into a new tab / window / incognito window. I read this a while ago, and as other say, it's worth it.


bizzarely the owner has put it behind a password login in the past few minutes. Still on the archive tho:

https://archive.is/Zuz68


Given the design, I reckon they might well be on a tiny hand-crafted server, in which case it makes sense. I seem to remember something similar the last time this was posted.


Because of ai companies' web crawlers overloading their bandwidth ?


I use Smart Referer to disable this, but the extension appears to be unmaintained:

https://gitlab.com/smart-referrer/smart-referer

https://addons.mozilla.org/en-US/firefox/addon/smart-referer...

Anyone know of a reputable replacement?


This was a great read, thank you for sharing it!


Once you realize that elisp is a better shell programming language than bash, it ceases to appear insane.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: