View Single Post
  #2   (View Single Post)  
Old 19th March 2011
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,975
Default

The information technology industry uses three types of lies:
  • Lies
  • Damned Lies
  • Benchmarks
A benchmark is only a relative indicator, using a synthetic workload. Over the years, some software tools ... most notably DBMS software ... have had code that recognized a synthetic workload and "aha! Benchmark being run!" shortened internal path lengths accordingly.

Even the comparison you refer to provides this disclaimer:
Quote:
Warning:
These totals should be taken with a grain of salt
as they do not reflect the true difference in completion times.
Use an OS that meets your operational requirements. Or if you have none, run a test yourself, on YOUR hardware with YOUR application.
Reply With Quote