Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I believe you're being disingenuous. Perplexity is running a set of crawlers that do not respect robots.txt and take steps to actively evade detection.

They are running a service and this is not a user taking steps to modify their own content for their own use.

Perplexity is not acting as a user proxy and they need to learn to stick to the rules, even when it interferes with their business model.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: