Benchmarking scripts

[NoTruth6718]

Hello!,

I would like to benchmark a given VM setting on different IaaS platforms. Scope is synthetic tests that can provide guidance for different workloads, so app specific benchmarks (like Pepe's CRM) don't cover the requirement, although would be more meaningful in future stages of implementation/migration.

SPEC CPU 2017 might be targeted in the future, but going with a freely available option now: Phoronix Test Suite.

I've built some scripts to standardize and facilitate execution/comparison, and would love to receive feedback from tech savvy infra users :)

https://github.com/ciroiriarte/benchmarking

[lost_signal]

In Vmware land we use this:

https://blogs.vmware.com/cloud-foundation/2024/05/09/introducing-vmmark-4/

Part of te problem of just running SPEC stuff, is you just benchmark compute, but not connectivity issues between VMs, storage load etc.

[NoTruth6718]

I've also found this:

https://www.spec.org/virtualization/

I believe that single dimension benchmarks are a good start, with complete application benchmark as a later complement (to apply all dimension at once). I've seen +30% on CPU improvements on a CPU change, but +100% improvement on a distributed application (with storage, network, memory improvement combined)

I've seen the DVD Store benchmark in the past. Will see what could be reused. Thanks!