You have to get pretty damn rural before you need anything more than a bike to access a convenience store.
Obviously the absolute overwhelming majority of Japanese live in cities anyway, so it's not really comparable to the US.