For dealing with milder adhesives, try peanut butter or vegetable oil. Let it sit overnight, then wipe off. The only reason for considering peanut butter is that it doesn't drip off while the oil does its work.

I'm not averse to "chemicals" per se, but I like to minimize the number of different specialty liquids I have to find a place for in my house.