Certainly, the term "organic" is abused, much like the term "natural" (which also doesn't mean what people think it means). However, surely the kind of pesticide you use matters. And while nothing in principle guarantees that naturally-sourced pesticides are guaranteed to be non-toxic (except the pests in question, etc), the ones that are generally used[0] are undoubtably safer than "conventional" pesticides.

[0] http://www.xerces.org/wp-content/uploads/2009/12/xerces-orga...