git remote set-url --add origin ...

Short is create a CNAME file in your site repo with your custom DNS in it, then add a CNAME in your DNS pointing to the GitHub pages DNS.