Enjoyment is a different thing than admiration. Folks who initially enjoyed Adams' work, later found they couldn't.
His work had become associated with his opinions and folks were unhappy with having his remarks return to their mind again and again. Losing his books stopped that cycle.
I've gotten rid of stuff that had negative associations for me. It was good for me.
Basically, what do you value more and what can you excuse?