Because you live in a world where other people exist, and how they go about existing can impact you negatively, both directly and indirectly. The fewer people living in and dealing with poverty, the better off the everyone else is.