NVidia GPUs basically have an NPU, in the form of Tensor units. They don't just happen to be good at matmul, they have specific hardware designed to run neural networka.

There is no actual distinction. A GPU with Tensor cores(=matmul units) really does have an NPU just as much as a CPU with an NPU (=matmul units).