General Performance
While gaming performance is suffering due to the changes to the underpinning of Vista, general performance does fare a little better.
Overall, performance under Vista is still below that of XP, but again due to the debugging system in place, we have no way of knowing just how much of this is Vista being artificially held back by it. With the exception of the OpenGL shading score of Cinebench, which again highlights the poor performance of the current video implementation on Vista, nothing else is doing too poorly on Vista compared to XP. Vista x86 comes in behind XP in everything, but these scores are much more encouraging than the gaming scores, and they suggest that any performance deficiencies will be sorted out by the time Vista goes gold.
As for Vista x64, specifically on Cinebench which is our only 64-bit-enabled benchmark, Vista x64 actually pulls ahead of both Vista x86 and XP, showcasing the potential of x64 when used intelligently. We're also seeing the same general quirks of running 32-bit software on a 64-bit version of Windows: it performs slightly better than on the equivalent 32-bit version at times.
Startup Times
We also tested the boot times for a clean install of each operating system, using a stopwatch to see how long it took for the OS to boot to the point where it presented a usable login screen.
It shouldn't come as a surprise that Vista took longer than XP to boot, if only because it's a much bigger OS overall than XP. Compared to the boot times for XP, Vista x86 takes a full 60% longer to boot up than XP, and while in absolute terms this is only 18 seconds for an activity that will be happening rarely, it's still disappointingly long. Vista x64 in turn is in a category all of its own with 73 seconds, nearly the amount of time it would take to boot Vista x86 and XP combined. Because of the WOW64 translation layer, it's not a stretch to say that Vista x64 is really loading 2 operating systems anyhow, but anything over a minute is an unacceptably long period of time to wait on just the operating system to boot, and this is not even factoring in the time it takes for a user account to load.
We'll take a look at this again when the final versions of Vista ship, but it's not likely that boot performance will be able to improve to the point where Vista actually loads faster than XP, at least not without additional new hardware.
While gaming performance is suffering due to the changes to the underpinning of Vista, general performance does fare a little better.
General Performance | |||
XP | Vista x86 | Vista x64 | |
Cinebench 9.5 (Rendering) |
363 | 347 | 340/376 |
Cinebench 9.5 (OpenGL shading) |
3934 | 2613 | 2330/2499 |
Adobe Photoshop CS2 (seconds) |
220 | 243.7 | 235.5 |
AutoGK Encoding (Xvid 1.1 - seconds) |
1040 | 1141 | 1094 |
Overall, performance under Vista is still below that of XP, but again due to the debugging system in place, we have no way of knowing just how much of this is Vista being artificially held back by it. With the exception of the OpenGL shading score of Cinebench, which again highlights the poor performance of the current video implementation on Vista, nothing else is doing too poorly on Vista compared to XP. Vista x86 comes in behind XP in everything, but these scores are much more encouraging than the gaming scores, and they suggest that any performance deficiencies will be sorted out by the time Vista goes gold.
As for Vista x64, specifically on Cinebench which is our only 64-bit-enabled benchmark, Vista x64 actually pulls ahead of both Vista x86 and XP, showcasing the potential of x64 when used intelligently. We're also seeing the same general quirks of running 32-bit software on a 64-bit version of Windows: it performs slightly better than on the equivalent 32-bit version at times.
Startup Times
We also tested the boot times for a clean install of each operating system, using a stopwatch to see how long it took for the OS to boot to the point where it presented a usable login screen.
Operating System Boot Time | |||
XP | Vista x86 | Vista x64 | |
Time in seconds | 30 | 48 | 73 |
It shouldn't come as a surprise that Vista took longer than XP to boot, if only because it's a much bigger OS overall than XP. Compared to the boot times for XP, Vista x86 takes a full 60% longer to boot up than XP, and while in absolute terms this is only 18 seconds for an activity that will be happening rarely, it's still disappointingly long. Vista x64 in turn is in a category all of its own with 73 seconds, nearly the amount of time it would take to boot Vista x86 and XP combined. Because of the WOW64 translation layer, it's not a stretch to say that Vista x64 is really loading 2 operating systems anyhow, but anything over a minute is an unacceptably long period of time to wait on just the operating system to boot, and this is not even factoring in the time it takes for a user account to load.
We'll take a look at this again when the final versions of Vista ship, but it's not likely that boot performance will be able to improve to the point where Vista actually loads faster than XP, at least not without additional new hardware.
75 Comments
View All Comments
stash - Friday, June 16, 2006 - link
Sleep is more effecient in the long run. Shutting down and doing a cold boot every day uses a lot more electricity than sleep. When the machine is in sleep, it uses a fraction of a single watt. Yes, this is obviously more than zero (completely off), but when you cold boot a system, it uses many times more power.As a side benefit, you get back to where you left off almost instantly because sleep combines standby with hibernation.
Griswold - Friday, June 16, 2006 - link
Oh so wrong. Why would a cold boot use more power? Because the HDDs spin up? Going from sleep to full on does the same. Because the OS has to be loaded from the HDD? Sleep mode also writes to disk. And thats actually it. This is a computer, not an engine that uses more fuel at startup than when it runs.stash - Friday, June 16, 2006 - link
When you can resume from sleep in a few seconds compared to 45-60 seconds from a cold boot, then yes, a cold boot uses much more power.johnsonx - Friday, June 16, 2006 - link
Stash, your logic is faulty. Please give up.stash - Friday, June 16, 2006 - link
Why should I give up? How is my logic faulty.smitty3268 - Friday, June 16, 2006 - link
<I>Is Expose the same as the new compiz and XGL?</I>No, that is more like the Aero interface or OSX's Quartz Extreme. Expose lets you hit a button and then automatically scales and moves every window so that you can see them all and pick out which program you want to use. Think of it as a replacement for ALT-TAB. There is a plugin in compiz that does the same thing.
Locutus465 - Friday, June 16, 2006 - link
Not sure what your issues with 3D were, I only skimmed the artical so I'm sure which video card you used... But it's possible that if you're using ATI you experienced problems due to their drivers. I've seen many more ATI issues in the MS groups than nVida. My 7800GT has no problem with 1600x1200 (full 3d acceloration, no apparent crashing). My only concern wth Vista 64 is drivers... As of right now there's no driver avaailable for the Promies Ultra100TX2 controller card which is a huge issue for me as I have my secondary drive (used to store installers and as my page file drive in XP). I hope MS manages to convince to support 64b as well as 32b is supported. When I do upgrade to Vista, it will be to 64b.JarredWalton - Friday, June 16, 2006 - link
Page 10: using 6800 Ultra card.The problem is both with drivers (64-bit are still being worked on), the OS (still being worked on), and resource requierments are increased under 64-bit mode. Compatibility with various hardware is already worse with Vista, but 64-bit mode is even worse still. Can they fix it before shipping? Hopefully, and one way or another we're going 64-bit in the future.
It could be that other test systems would be more or less stable, but with a preview of Vista Beta 2 that's really too much extra work. The article was already over 12000 words, so trying it out on five other platforms would make this monolithic task even more daunting. The bottom line is that Vista is still interesting, but it's definitely not ready for release. There's a good reason it has been delayed until 2007, just like the XP x64 delays in the past.
DerekWilson - Friday, June 16, 2006 - link
We have tested Vista with both ATI and NVIDIA drivers and see similar issues between the two. While the numbers were gathered under NVIDIA hardware, we are confident that the same patterns would emerge with ATI at this point in time.Locutus465 - Friday, June 16, 2006 - link
Well, weird... I've had my share of beta issues but thus far Glass + 3D acceleration hasn't been one of them. I have noticed that installing QuickTime 7 on Vista (at least in my case) renders Vista Ultimite 64 unbootable.