I know a technique that's more appropriate than sharding for the sheer majority of cases: personal computing running libre software. Most of the times there are such embarrassingly parallelizable workloads is because something got needlessly centralized.