We think videos are special. There is a reason why Khan Academy, Coursera, etc. are essentially video libraries. A lecture video is a recording of a teaching performance, a form of presentation where someone explains while controlling what you see and when you see it.
And in the coming months, we’ll make the answers themselves real-time videos, which is kind of trivial for us at this point. We’ll ask the LLM to answer by writing code, and our software will render that code and show you the response directly as a video.
We’re not using video generation models. We ask an LLM to write the lecture as code, then render it deterministically with computer graphics and TTS.
So the main costs are the LLM call, TTS, and some cloud GPU time for rendering. That ends up being much cheaper than generating long form video directly with video models.
We ask Claude Opus 5 to write a specific kind of source code that only our proprietary software understands and can render into a lecture video with computer graphics and TTS.
Without our system, there isn’t really an equivalent target language you can ask the LLM to write. Manim exists, but you won’t get videos like these by simply asking an LLM to generate Manim code.
On consumer devices, AI communicates with us through speakers and screens. Screens are the richer medium, so most consumer AI innovation will happen there.
Computer graphics will have enormous applications because they are directly controllable by LLM-generated code. Video models are probabilistic and less suitable when precision matters. In education, for example, we need exact visuals. If an AI wants to plot y = sin(x), it should generate the precise graph through computer graphics rather than approximate it with a video model.
Coding, graphics, all seem to have very defined background data for an LLM to base their decisions on, test, and even when I correct it we're all on the same page. Seems like there's lots of room for AI productivity there.
What I find funny is that approximate to computer graphics are video games. When I ask AI about a decision available to me in a video game AI completely fails, OFTEN. I assume all the forums and changes made to a game over time might be quite confusing for AI. But I've also seen it completely make up characters and decisions and weapons and so on about some very clearly defined games and paths. It's an interesting dynamic.
https://academa.ai