Mathematical concepts are usually pretty intuitive. I think that the problem is more the notation that we teach than math itself being unintuitive and difficult.

I'd also say that programming is a mathematical endeavor by nature; logical manipulation is a branch of mathematics. If you're working at a level of abstraction where you aren't specifying logical manipulations, then you're filling out a template, not what I'd call "programming".