I'd say if your organization is large enough to differentiate between "UX Developer," "Traditional Developer," and "Designer" then yes there are going to be communication problems. It shouldn't be disparaging to either side.

Also it doesn't have to be a middle-man. 3-way communication usually works fine.