c0t0d0s0.org - On Benchmarketing http://www.c0t0d0s0.org/ the sun in a lighthungry universe en Serendipity 1.3 - http://www.s9y.org/ Lies, fucking lies and Benchmarks http://feeds.feedburner.com/~r/C0t0d0s0org-OnBenchmarketing/~3/316440006/1972-Lies,-fucking-lies-and-Benchmarks.html On Benchmarketing http://www.c0t0d0s0.org/archives/1972-Lies,-fucking-lies-and-Benchmarks.html#comments http://www.c0t0d0s0.org/wfwcomment.php?cid=1972 2 http://www.c0t0d0s0.org/rss.php?version=2.0&type=comments&cid=1972 nospam@example.com (Joerg Moellenkamp) Scientias Blog.


Continue reading "Lies, fucking lies and Benchmarks" ]]> Mon, 04 Sep 2006 20:34:10 +0200 http://www.c0t0d0s0.org/archives/1972-guid.html On Benchmarketing http://creativecommons.org/licenses/by-sa/2.5/ http://www.c0t0d0s0.org/archives/1972-Lies,-fucking-lies-and-Benchmarks.html The future of TPC ? http://feeds.feedburner.com/~r/C0t0d0s0org-OnBenchmarketing/~3/316440007/1821-The-future-of-TPC.html On Benchmarketing http://www.c0t0d0s0.org/archives/1821-The-future-of-TPC.html#comments http://www.c0t0d0s0.org/wfwcomment.php?cid=1821 0 http://www.c0t0d0s0.org/rss.php?version=2.0&type=comments&cid=1821 nospam@example.com (Joerg Moellenkamp) new TPC benchmark suites. It´s good to see, that the media support Sun opinion, that TPC-C is absolutly useless this days. It should be subsituted by something more realistic sooner than later:
One problem with TPC-C was the ease with which certain servers could generate unrealistically high scores using hardware and software configurations that are highly improbable in the real world. For example, high TPC-C scores come from servers with colossal numbers of hard drives--6,548 in the case of IBM's top score.
and
Another problem hinged on the fact that TPC-C's test was easily distributed among relatively independent servers linked in a cluster. That gave the impression that a number of inexpensive machines were as good as a single multiprocessor behemoth, leading the consortium to list results separately for clustered and non-clustered systems.

]]> Tue, 25 Jul 2006 20:59:11 +0200 http://www.c0t0d0s0.org/archives/1821-guid.html benchmarks On Benchmarketing sun http://creativecommons.org/licenses/by-sa/2.5/ http://www.c0t0d0s0.org/archives/1821-The-future-of-TPC.html Sidenote: UltraSPARC T1 and SPECweb2005 http://feeds.feedburner.com/~r/C0t0d0s0org-OnBenchmarketing/~3/316440008/1789-Sidenote-UltraSPARC-T1-and-SPECweb2005.html On Benchmarketing http://www.c0t0d0s0.org/archives/1789-Sidenote-UltraSPARC-T1-and-SPECweb2005.html#comments http://www.c0t0d0s0.org/wfwcomment.php?cid=1789 0 http://www.c0t0d0s0.org/rss.php?version=2.0&type=comments&cid=1789 nospam@example.com (Joerg Moellenkamp) SPECweb2005 benchmark by roughly 4000 points. And this benchmark was made on the T2000 in November last year. Even the new Woodcrests stopped short of 10000 points and that were already fully blown 4 core systems (maximum for Woodcrest right now). Now keep in consideration that Niagara II already runs in our labs. Interesting times . Well ... Rolf, we should do the power meter gag again next cebit ;-) ]]> Tue, 18 Jul 2006 22:10:03 +0200 http://www.c0t0d0s0.org/archives/1789-guid.html niagara niagara ii On Benchmarketing sun ultrasparc ultrasparc t1 http://creativecommons.org/licenses/by-sa/2.5/ http://www.c0t0d0s0.org/archives/1789-Sidenote-UltraSPARC-T1-and-SPECweb2005.html On benchmarketing - or: new Netapp benchmark http://feeds.feedburner.com/~r/C0t0d0s0org-OnBenchmarketing/~3/316440009/1636-On-benchmarketing-or-new-Netapp-benchmark.html On Benchmarketing http://www.c0t0d0s0.org/archives/1636-On-benchmarketing-or-new-Netapp-benchmark.html#comments http://www.c0t0d0s0.org/wfwcomment.php?cid=1636 0 http://www.c0t0d0s0.org/rss.php?version=2.0&type=comments&cid=1636 nospam@example.com (Joerg Moellenkamp) 1.000.000 operation per second. But look at the bill of material: 24 Filerheads, not the small one, the NetApp 6040 is one of the bigbadass machines, 768 Gigabytes of Cache, 48 GB NVRAM, 1152 Harddisks. Does anybody uses really a environment like this? It´s seems to me like using an SF25K for fileserving.
This is the nature of benchmarketing. It´s not a matter of being realistic of realistic workloads, it´s a expression of the fine art of understanding and outsmart a benchmark to make a marketing statement. ]]> Tue, 13 Jun 2006 21:41:09 +0200 http://www.c0t0d0s0.org/archives/1636-guid.html benchmarketing On Benchmarketing http://creativecommons.org/licenses/by-sa/2.5/ http://www.c0t0d0s0.org/archives/1636-On-benchmarketing-or-new-Netapp-benchmark.html