Throughput is not a problem as you just share relatively small vectors (a few ki... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

stymaar 4 months ago | parent | context | favorite | on: Mesh LLM: distributed AI computing on iroh

Throughput is not a problem as you just share relatively small vectors (a few kilobytes in size), the key issue is network latency.

jmercouris 4 months ago [–]

I didn't mean the throughput of the network, I meant the throughput of the calculations. Yes, the latency is the issue.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact