Curious about: does it have fault tolerance if one of the machines goes down mid... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

DerivativeBS 85 days ago | parent | context | favorite | on: Mesh LLM: distributed AI computing on iroh

Curious about: does it have fault tolerance if one of the machines goes down mid-inference? Can it dynamically reroute, or does it just retry?

i386 85 days ago [–]

It can dynamically route. If a machine drops out of split, the topology is recalculated and the request is automatically retried.

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact