As someone that is familiar with using nvidia-smi to track util, what are some c... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ScoutOrgo on Aug 23, 2024 \| parent \| context \| favorite \| on: GPU utilization can be a misleading metric As someone that is familiar with using nvidia-smi to track util, what are some commands people use to track the SM efficiency? The end of the article had some references, but no examples of what to use explicitly.

roanakb on Aug 23, 2024 [–]

Unfortunately, SM efficiency is not accessible via nvidia-smi. The best methods to track it would be to:

1. Profile your model with Pytorch Profiler 2. Export metrics with Nvidia DCGM

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact