Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Not true and citation needed. Whatever you cite there are competing papers claiming that structured and constrained generation does zero harm to output diversity/creativity (within a schema).


That is clearly not possible. Imagine if you asked a model yes/no questions with a schema that didn't contain "yes".

In general you can break any model by using a sampler that chooses bad enough tokens sometimes. I don't think it's well studied how well different models respond to this.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: