I largely agree. But tone is, in practice, more than just the pitch. I know that in Mandarin it ends up affecting vowel length, volume and quality a little bit as well. I'm pretty sure you could do much better than chance just with lip position over time, for example. And practical lipreading looks at much more than just lip position.