There is a youtube video from a google engineer that talks about their backup.

Your data is (supposedly) encrypted with your private key. They can't guarantee that all copies are deleted, but they can (at least in theory) delete the key to make the data inaccessible. Whether you believe them or not is a different story...