If the computer is compromised or backdoored, it will have access to private keys for websites that I access on that computer, one per each touch, not the database of all private keys. For example, I may not connect my Yubikey to some computers at all.

Hardware keys are made not to give out secret keys without physical touch.

Firmware in Yubikey is not updated, unlike over the air phone update.