The stuff in ~/Library is caches + preferences + any other data. Deleting an app on macOS, even back in the day, did not delete the preferences.
The problems with Windows is that you needed an installer in the first place, and then an uninstaller, and then you couldn’t move an application to a different location. On a Mac, you can still just drag the application to the /Applications folder, or somewhere else, and then delete it later. The user data remains.
Lots of apps can litter junk all through macOS that goes well beyond the ~/Library folder. To totally rid yourself of everything, just manually search for the app name using FindAnyFile [0] and trash them.
So macOS is as shitty as Windows in terms of app install?
Anyway, accepted wisdom now is that applications should only run containerized, which would make uninstall as simple as deleting the container.