Storing and transmitting the consensus is not the issue. The issue is that you need to decide what relays get into the consensus. You also can't choose a system where different clients get different relay directories, or people will be able to profile clients by which relay directories they're using.