As far as I'm concerned the IA can stick this up their arse.
They REFUSE to acknowlege my request to have a personal website that they've managed to archive removed.
It's a person blog that I want online so I can give the URL to family and friends, but I keep it out of Google etc with robots.txt. But once during an upgrade of the backend software I stuffed up the robots.txt and they crawled it until I fixed it up.
Will they reply to my emails? They will not. I'm so frustrated, they just IGNORE emails.
You picked the dumbest possible method to share something privately with family and friends but it's the Internet Archive's issue to fix? A robots.txt provides zero protection for a public website.
I didn't say it was private. It's obviously public, I give you the URL and you can pull it up. I'm not stupid enough to think that robots.txt means no one can read it! There's some RBAC control so that you need to be logged in etc if I publish anything I wish to remain private.
Most _reputable_ organisiations will respect robots.txt and not crawl your site, nor cache/archive your data if you request it.
What I want is the decision that someone's going to archive/store my website somewhere else to be MY decision, not theirs.
I have hints that they may be understaffed. If you had a little spare time, you could lend a hand to their legendary effort, and maybe contribute in fixing a few things such as your issue.
Will they reply to my emails? They will not. I'm so frustrated, they just IGNORE emails.
Don't support these clowns.