Please don't do that with banana or orange peels, they remain present for a long time. I have no problem personally with people tossing apple cores in more remote, little-visited areas (though it still makes sense to crack down on such things a bit more in heavily visited areas like National Parks) but various peels don't rot well and remain in place.