HPC Release Notes Automation
Automating the weekly HPC release notes process which means it can get more comprehensive!
For roughly two years I’ve been putting together release notes from the major cloud providers that are relevant to people that care about HPC. By Hand. Like some kind of caveman. Every week I’d read the release notes and pick out the bits that are HPC relevant.
I did try and automate it a couple of times, for some definition of try. Yea ok I just told Claude and ChatGPT to do it in a web chat window. I didn’t try very hard. Anyway, that never seemed to work very well. Mostly I seem to struggle getting it to correctly identify what might be HPC relevant.
Last weekend though I tried a bit harder. I AI first engineered, nah who am I kidding, I straight up vibe coded a web app that reads the RSS feeds from the cloud providers, attempts to classify them, mostly fails and gives me a way to swipe left or right on each release note so you still get a nice, curated list.
It needs a little (maybe a lot?) more work before I put it live and I’m sort of playing with writing my own ML classifier based on the last two years of data rather than using an LLM.
Don’t worry, one of the items on the to-do list is a way for me to add the odd snarky comment against the releases like you get in todays version 😆
Now that this process is a bit more scale-able, not only can I add a more clouds and possibly neo clouds to the RSS list, but other vendors too that produce HPC relevant products. Well so long as they have an RSS feed, I guess. So, who else should I add?
More importantly, it will need a name. Suggestions?
