It was originally invented by Donald Knuth in 1984. He created Web (not the World Wide Web) for this purpose.

See e.g. http://www.literateprogramming.com/

What GP is referring to isn't literate programming. It's more like doc comments moved to the side instead of inline. Not sure it ever had its own name.