As I've been playing with the IO500 benchmark on various systems, I'm seeing a
fair amount of variability between runs. This may ultimately be to my detriment, but have
there been any discussions of perhaps requiring the mean of 3 or 5 runs for the official
numbers? I think the most striking examples are when I've managed to hit some kind of
storage side caching just right and produced numbers, particularly on mdtest_hard_stat
that are an order of magnitude greater on one run vs other runs. Now, I really LIKE having
a higher score, but it doesn't seem exactly fair or representative...
--Ken Carlile
Show replies by date