Network World
Saturday, November 22, 2008
DNSstuff.com
Get information about your IP
IP Information
50+ On-demand DNS and network tools

Community

Navigation

Poor methodology

(Re-written from my comment at lwn.net):

This isn't a particularly well-conducted test.

Most notably:

- The article measures power draw under load without measuring performance. A configuration that simply went slower and required more power in total (due to greater time requirements) to
complete a task would thus "win" the test.

- The "power saver" instead of "balanced" profile for 2008 server was used. That's a poor choice for a server under any circumstances and may even use *more* power to complete a given job because it can prevent the CPU from spiking to max performance to finish a job quickly.

- The load test was not likely to make a modern server work hard. Something like a file or database server load generator might have been a better choice. I guess if it was virus-scanning and spam-checking vast piles of mail...

- CPUs, including server CPUs, supported the HLT instruction for reduced CPU power draw well before frequency and voltage stepping arrived on the scene even for laptops. Servers haven't run on full-tilt power max when idle for a *long* time.

- The article falls for the all-too-common pretty but misleading non-zero-y-origin graph trap. Argh!

A more useful test would've defined jobs to do (100 loops of this database load test; process 1 million spam-filtered and virus-scanned emails; etc). It would measure total energy (joules) consumed to complete the task in various power modes. It would then ALSO consider idle draw and full-tilt peak draw - both of which matter for, among other things, cooling needs - as secondary concerns.

Click to read the article this is in response to.

Red Hat Linux greener than WS2008

0

Windows users: Note this line from the test: "The variable settings allowed by both Windows and Linux – which let you toggle between having a high energy efficient server vs. a high performing one – can certainly have an impact on overall server consumption."

We would disagree; two tests are examples and 100 wouldn't be en

0

Email, not the web, is the most active application that a server sees, and so we chose it to perform our active testing using products commonly found on both Linux and Windows platforms. YMMV, as will most applications. Still, these are representative of four hours of active email use on both platforms. We also chose a quiet state to show server quiescence and baseline load given two power settings, and power settings are nearly infinite in their changes.

Sendmail vs. Exchange

0

The test also fails because you're not comparing apples to apples.

Let's have a race between a tugboat and a freighter and see which one uses more diesel to travel 10 miles.

To wit, let's compute the total number of CPU cycles required to send 1 email via Exchange, and total number of CPU cycles required to send 1 email via Sendmail. I'd be willing to bet that Windows / Exchange requires far more CPU cycles than Linux / Sendmail. That could be the reason for the power difference.

Sendmail vs. Exchange

0

To wit, a Linux/Sendmail installation would use less power than a Windows/Exchange one, as you just pointed out. Despite the tortuous and petty arguments, what people want to know is if the Linux installation overall or the Windows installation overall, on balance use less power. Yes, there could be better loads for the test scenarios, but it is useful comparison nevertheless.

It might use less power; that's the point.

0

This is a comparison of two servers, at speed, over the test duration, with a constant amount of emails hitting the servers. If one uses less power, that was measured.

Agreed

0

Very poor Methodology indeed.

JT
http://www.anondo.alturl.com

I agree

0

The method is flawed, but I am curious to see what results a good test would produce. http://elfurl.com/2f9oi

Tests are Flawed Indeed

0

We conducted testing around this same subject over at my lab at Microsoft for over 6 months. You can get the whitepaper and all of the testing appendixes through this blog entry. http://blogs.technet.com/windowsserver/archive/2008/06/10/new-windows-server-2008-power-management-whitepaper-released.aspx

my windows 2000 advanced server is 47 watts at idle

0

thats with 3 SATA drives and one SCSI drive

linux

0

distrubution of software and manufactureing costs makes linux greener than windows. but linux isnt as compatable as modern macintosh and windows machine

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <i> <b> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <blockquote> <br /> <br> <p>
  • Lines and paragraphs break automatically.
  • You can use BBCode tags in the text.
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.

Advertisement: