Do you use Nvidia Cuda on Grid Engine? Here is a GPU Load Sensor which supports Cuda that enables Grid Engine to schedule according to your current Cuda capacity and capabilities.
It has been tested against SGE 6.2u5 and UGE 8.0.0, but should work with any 6.x or later Grid Engine. It has been built against Cuda 2.2, 2.3 and 3.2.
Still some work to do to tune how the load values are set, and what types they are. I would like to hear from anyone trying it out, and suggestions on how best to use it to launch jobs.
Grab it here
https://github.com/StephenDennis/gpu-load-sensor
Photo: 1971 (probably) Plymouth Barracuda pic from Dominics Pics. V8 Engine....coincidence?
This is pretty cool, but have you taken a look at NVML (NVIDIA management library)? This is new in the 270 driver and with CUDA 4.0. It has a lot more flexibility when it comes to reporting this sort of information. Feel free to contact me offline as it is my team that works on these technologies.
ReplyDelete