Benchmarks & Goodhart’s Law
Make sure you understand your workload. Putting your faith in benchmark results may lead you astray.
Everything tagged: HPC Benchmarks
Benchmarking Results for HPC
Performance Normalised Cloud VM Pricing for CFD
We’ve previously shown how to optimise cloud HPC costs through the use of automated benchmarking and price capture in financial services. Let’s see if it works for CFD too…
ORE v12 Released
Acadia releases version 12 of Open Risk Engine
Raspberry Risk
Ever wondered how many Raspberry Pis it takes to run your risk analytics? Sounds like the setup for a joke, right? Its not. And we have an answer!
HPC on Cloud — Cost Optimisation & Cloud Economics
A look at the economics of running a HPC system on a public cloud infrastructure. It looks at the impact of the performance differential between different types of VM, the impact of price variation and introduces the concept of a performance normalised price to allow easier comparison of VMs.
HPC on Cloud for Financial Risk — A Comparative Analysis
This article presents the results of running the COREx benchmark on over 650 different VM types across the three major cloud providers. It attempts to contextualize these results and help HPC practitioners interpret them to optimise their systems, as well as discuss the methodology employed.
Hyperthreading in HPC: On or Off?
This article discusses the use of simultaneous multi-threading (hyper-threading) in HPC, with a particular emphasis on financial risk systems and the COREx benchmark. It looks into the SMT status of cloud virtual machines, the ability to enable or disable and the cost implications of doing so.
COREx - A Financial Risk HPC Benchmark
Evaluating hardware performance such that it correlates well to your own use case is always difficult.Financial risk system specific benchmarks can be even more of a challenge due the proprietary and often secret nature of the code involved. This article looks at developing such a benchmark.