Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You stopped typing; what does Kubernetes do a bad job at with relation to scheduling workloads that declare they need at least 1 GPU resource but should be limited to no more than 4 GPU resources on a given Node? https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus...


Because they aren't consistently available in one region, and Kubernetes can't scale globally. If you don't believe me, go try to train LLMs on Kubernetes with on demand resources, good luck!


Oh, ok, sorry, I didn't realize that we were conflating Kubernetes, a container orchestration control plane, with your favorite cloud provider not putting in enough GPU hardware orders per region. My fault


You should try to actually build an ML product so you see what the issue is instead of a being a smug poodle.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: