Each of the problems you describe will become a slew of startups and open source projects. Compared to the typical web stack things are really immature and it'll be interesting to see how everything shakes out and fills in.

As a sidenote, looks like langchain is working on some of this: https://www.langchain.com/langsmith.