No, we mostly spent our time on data structures and algorithms.

Ugh, good point.

Usually, those get released a few weeks later.

I'm quite confused by this article. If you persist conversation history in a database, and have all agentic turns run on the server, and merely listen to the streaming events/history via a websocket on the client, this is easily achieved. You can have as many clients as you want.

The HTTP layer is fine. Websockets work great. This is how the Codex app server works, I believe: https://openai.com/index/unlocking-the-codex-harness/ Same pattern I've used in my agentic OS/personal assistant project: https://github.com/abi/lilo Works great!

Codex is great.

Exactly.

I’ve experienced that issue as well. Clearing the cache and redownloading seemed to fix it for me. It’s an issue with the upstream library tvmjs that I need to dig deeper into. You should be totally fine on a 32gb system.

FWIW mine fails on the same file. I've tried a few times, including different sessions of Incognito, but seem to repeatedly get the same error with Llama 3 model:

"Could not load the model because Error: ArtifactIndexedDBCache failed to fetch: https://huggingface.co/mlc-ai/Llama-3-8B-Instruct-q4f16_1-ML..."

Use secret llama in a incognito window. Turn off the Internet and close the window when done.

Thanks for the bug report. Yeah, it’s a bug with not resetting the state properly when new chat is clicked. Will fix tomorrow.

Chat history shouldn’t be hard to add with local storage and Indexed DB.

Yes. Web-llm is a wrapper of tvmjs: https://github.com/apache/tvm

Just wrappers all the way down

And one day you realize wrappers are what it was all about

You betta lose yaself in the music tha moment you own it you betta neva let it go (go (go (go))) you only get 1 shot do NAHT miss ya chance to blow cuz oppatunity comes once inna lifetime (you betta) /gunshot noise