Scheduler Selection Made Easy
Need something to help pick the right HPC scheduler? We have something. Now we just need your help to make sure we’ve covered all the bases.
You have thousands of C/GPUs at your disposal and even more workload to run on them. How do you pick the right scheduler?
Earlier this year (and longer ago than I thought 😊) I wrote about a little project to help pick an HPC scheduler that Alex Kimber had come to me with as an idea.
We had some great initial feedback and conversations with vendors of schedulers and though it has taken longer than I thought it would, we have a beta version ready. Did I mention it’s a beta version? Don’t forget, this is beta. An early beta at that.
The questions and scheduler features are all config driven to allow them to be easily updated. We’re working on a way to skip questions based on the answer to previous questions (e.g. if you don’t need to use cloud).
I have tried to populate the feature sets to the best of my ability but I’m sure I will have made some mistakes. I am also all too aware that there are many schedulers that exist that are currently missing. Given I hadn’t even heard of some of them till relatively recently, the chances of me correctly populating the feature sets are pretty low.
This is where you all come in. The more schedulers we have and the more accurate the data about their respective feature sets, the more useful this becomes.
I’ve made what I hope is a good attempt at the questions though these can be changed easily too if required.
The project is GPL 3.0 licensed too as an attempt to ensure any contributions are retained in the public domain.
You’re welcome to raise a PR, drop me an email or DM or just comment below. Over to you!
hmxlabs
