TermKit[1] was built in this way a few years ago. It was novel at the time and the demo[2] seemed promising, but looks like it hasn't been updated in ~2 years now.

[1] https://github.com/unconed/TermKit

[2] http://www.youtube.com/watch?v=_6Z5dnlfcls