One approach that we take at MayaData is to explicitly compare the performance of our software - and the NVMe-oF capable OpenEBS Mayastor in particular - to the theoretical maximum performance of underlying devices and cloud volumes. You can see this approach in benchmarking of OpenEBS Mayastor with our friends at Intel. It is our hope that this approach will provide somewhat of a common denominator for performance comparisons. We also find that users appreciate this - they can trade off the benefits of our software vs. the risks inherent in simply using the raw disk and local persistent volumes without the management or resilience advantages offered by OpenEBS Mayastor.
A second approach we take is to offer tools that assist in creating this real world environment. In particular, we authored an automation playground that is extensible. It can deploy Kubernetes itself and relevant workloads and relevant benchmarks for those workloads. Please take a look and contribute your thoughts and help this open resource grow in value.
Have a question on benchmarking or want to talk to us to test your application?