Hardware Setup

Standard Test Bed
Playback of iPeak Trace Files and Test Application Results
Processor: AMD Opteron 175 utilized for all tests.
RAM: 2 x 1GB Corsair 3500LL PRO
Settings: DDR-400 at (2.5-3-3-7, 1T)
OS Hard Drive: 1 x Western Digital WD1500 - SATA - 16MB Buffer - 10,000RPM
System Platform Drivers: NVIDIA Platform Driver - 6.85
Video Card: 1 x ASUS 7600GS (PCI Express) for all tests.
Video Drivers: NVIDIA nForce 84.21 WHQL
Optical Drive: BenQ DW1640
Cooling: Zalman CNPS9500
Power Supply: OCZ GameXStream 700W
Case: Gigabyte 3D Aurora
Operating System: Windows XP Professional SP2
Motherboard: MSI K8N Diamond Plus

Our current test bed reflects a common level system that has been in use for a year now. Based upon the continuing proliferation of dual core processors and future roadmaps from AMD and Intel signifying new chipset and processor designs, we will revise our test bed shortly to reflect these changes in the marketplace. This change will also allow us to expand our real world multitasking benchmarks in the near future while providing a stable platform for the next few months. We are currently conducting preliminary benchmark testing under Vista with both 2GB and 4GB memory configurations. We will offer real-world Vista benchmarks once the driver situation matures but iPeak results will continue to be in XP as the application is not compatible with Vista.

Test Setup - Software

With the variety of disk drive benchmarks available, we needed a means of comparing the true performance of the hard drives in real world applications. While we will continue to utilize HDTach and PCMark05 for comparative benchmarks our logical choice for application benchmarking is the Intel iPeak Storage Performance Toolkit version 3. We originally started using this storage benchmark application in our Q2 2004 Desktop Hard Drive Comparison. The iPeak test can be designed to measure "pure" hard disk performance, and in this case we kept the host adapter consistent while varying the hard drive models. The idea is to measure the performance of individual hard drives with a consistent host adapter.

We utilize the iPeak WinTrace32 program to record precise I/O operations when running real world benchmarks. We then utilize the iPeak AnalyzeTrace program to review the disk trace file for integrity and ensure our trace files have properly captured the activities we required. Intel's RankDisk utility is used to play back the workload of all I/O operations that took place during the recording. RankDisk generates results in a mean service time in milliseconds format; in other words, it gives the average time that each drive took to fulfill each I/O operation. In order to make the data more understandable, we report the scores as an average number of I/O operations per second so that higher scores translate into better performance in all of our iPeak results. While these measurements will provide a score representing "pure" hard drive performance, the actual impact on the real world applications can and will be different.

The drive is formatted before each test run and three tests are completed on each drive in order to ensure consistency in the benchmark results. The high and low scores are removed with the remaining score representing our reported result. We utilize the NVIDIA nF4 SATA ports along with the NVIDIA IDE-SW driver to ensure consistency in our playback results when utilizing NCQ, TCQ, or RAID settings. We will test with AAM and NCQ turned on with our Deskstar 7K1000 unit as AAM does not noticeably impact performance and this drive generally performs better with NCQ on in the majority of tests.

Our iPeak tests represent a fairly extensive cross section of applications and usage patterns for both the general and enthusiast user. We will continually tailor these benchmarks with an eye towards the drive's intended usage and feature set when compared to similar drives. In essence, although we will report results from our test suite for all drives, it is important to realize a drive designed for PVR duty will generate significantly different scores in our gaming benchmarks than a drive designed with gaming in mind such as the WD Raptor. This does not necessarily make the PVR drive a bad choice for those who capture and manipulate video while also gaming. Hopefully our comments in the results sections will offer proper guidance for making a purchasing decision in these situations. Our iPeak Test Suite consists of the following benchmarks.

VeriTest Business Winstone 2004: trace file of the entire test suite that includes applications such as Microsoft Office XP, WinZip 8.1, and Norton Antivirus 2003.

VeriTest Multimedia Content Creation 2004: trace file of the entire test suite that includes applications such as Adobe Photoshop 7.01, Macromedia Director MX 9.0, Microsoft Windows Media Encoder 9.0, Newtek Lightwave 3D 7.5b, and others.

AVG Antivirus 7.1.392: trace file of a complete antivirus scan on our test bed hard drive.

Microsoft Disk Defragmenter: trace file of the complete defragmentation process after the operating system and all applications were installed on our test bed hard drive.

WinRAR 3.51: trace file of creating a single compressed file consisting of 444 files in 10 different folders totaling 602MB. The test is split into the time it takes to compress the files and the time it takes to decompress the files.

File Transfer: individual trace files of transferring the Office Space DVD files to our source drive and transferring the files back to our test drive. The source and test drives are the same make and model for these tests. The content being transferred consists of 29 files with a content size of 7.55GB.

AnyDVD 5.9.6: trace file of the time it takes to "rip" the Office Space DVD. We first copy the entire DVD over to our source drives, defragment the drive, and then measure the time it takes for AnyDVD to "rip" the contents to our test drive. While this is not ideal, it does remove the optical drive as a potential bottleneck during the extraction process and allows us to track the write performance of the drive.

Nero Recode 2: trace file of the time it takes to shrink the entire Office Space DVD that was extracted in the AnyDVD process into a single 4.5GB DVD image.

Game Installation: individual trace files of the time it takes to install Sims 2 and Battlefield 2. We copy each DVD to our secondary test drives, defragment the drive, and then install each game to our source drive.

Game Play: individual trace files that capture the startup and about 15 minutes of game play in each game. The Sims 2 trace file consists of the time it takes to select a pre-configured character, setup a university, downtown, business from each expansion pack (pre-loaded), and then visit each section before returning home. Our final trace file utilizes Battlefield 2 and we play the Daqing Oilfield map in both single and multiplayer mode.

Features and Specifications HD Tune and HD Tach Performance
Comments Locked

48 Comments

View All Comments

  • Gaelstorm - Wednesday, October 8, 2008 - link

    This article was a long time ago, but the second to last comment before mine was talking about fair. If a program is not hard drive intensive and is just slow all around like the Sim 2, you are not being fair by mentioning that Raid 0 doesn't help it. Honestly nothing will help with that games load time except a faster computer overall. Even so that game loads horrible for the type of game it is. I can tell you right now, there are very few situations I have encountered where Raid 0 didn't way outperform a single drive for gaming or just feel on a desktop type system. All the arguing I read, actually made me rethink trusting information from certain sources at all.
  • Per Hansson - Tuesday, April 24, 2007 - link

    Some ideas, as could be seen on page 4 of the review the system was limited by something (flat graph in STR instead of what you would expect)

    This is probably because you are using the normal SCSI Miniport driver, which happens to be the only choice for Win2K and WinXP 32 bit

    WinXP 64bit, 2003 Server 32bit and 64 bit and Vista 32 bit and 64 bit has the new StorPort miniport driver, which improves performance tremendeously in RAID arrays

    Of course the controller cards driver must also actually support and use the StorPort driver instead of the normal SCSI miniport driver

    What this means in laymens terms is that it was not because the "software based" RAID controllers where crap that we got shitty performance in Win2K and XP, it was because those controllers had shitty drivers. Which really was MS fault.

    The really expensive RAID controllers however did not use the NT4/2000 Server etc native SCSI miniport driver but had their very own implementation (just as good as MS "all new" storport driver) which meant that they where not capped at about 100-150MB/sec, but rather unlimited... Try your review with 4 150GB Raptors in RAID-0, your performance will be the same because it is the drivers that is holding the system back...

    Please keep this in mind for your upcoming review ;)

    http://download.microsoft.com/download/5/6/6/5664b...">http://download.microsoft.com/download/...06-45ec-...
  • ShadowdogKGB - Saturday, April 21, 2007 - link

    You have 5 synthetics that tell us that two are faster in stripe but then you have 5 real world tests that aren't real world at all. Tell me who plays HL2 Lost Coast and Sims2 Neighborhood. I think you should just stop testing raid setups all together since you can't be honest about it.
  • Gary Key - Sunday, April 22, 2007 - link

    quote:

    You have 5 synthetics that tell us that two are faster in stripe but then you have 5 real world tests that aren't real world at all. Tell me who plays HL2 Lost Coast and Sims2 Neighborhood. I think you should just stop testing raid setups all together since you can't be honest about it.


    The Sims2 continues to be one of the top selling/played games in the world and HL2 along with its various versions is also a top played title. We are revising our benchmark suite to include WoW and a couple of other titles that were recently released. As far as the other benchmarks, compression/decompression and encoding are fairly common activities on a PC the last time I checked. ;-) What are we not being honest about?
  • jleboeuf - Saturday, April 21, 2007 - link

    I'd be interested to see what your results fair out w/ a raid 10 config w/ 6 drives. that's 3 terabytes, and completely mirrored
  • aethyrmaster - Friday, April 20, 2007 - link

    They said they only used a 64 kB (KiB if you prefer) stripe size. Using stripes of 128 kB size would most likely have changed the results significantly. If possible, I'd like to see results with a 256 kB stripe as well.

    Separately, I personally have used RAID 0, as well as used exactly the same drives in a non-RAID setup. I often times do a lot of transferring of video from my PC to other devices on a Gigabit ethernet network, and the extra 10 to 30 MB/sec transfer rate provided by RAID 0 is well appreciated when you are copying 400 to 800 MB (MiB) of video.
  • GOSHARKS - Friday, April 20, 2007 - link

    quote:

    Our preliminary acoustic testing revealed minor differences between the drives with the retail unit having an increase in noise levels at idle from 26dBA to 27dBA and load results going from 35dBA to 36dBA with AAM enabled at the silent setting of 128. At an AAM setting of 254 we noticed an increase from 27dBA to 28dBA along with load results increasing from 36dBA to 38dBA.


    Is that even statiscally significant? As it is, it can be slightly misleading.
  • Gary Key - Sunday, April 22, 2007 - link

    quote:

    Is that even statiscally significant? As it is, it can be slightly misleading.


    Not in the grand scheme of things but the tests were run five different times with the same results. We were providing information based upon having a retail drive to test instead of the OEM drive we had in the first article. There were a few comments that suggested differences could have existed between the two so we tried to answer it.
  • tshen83 - Thursday, April 19, 2007 - link

    reviewing a 1TB drive by raid 0? the writer obviously have NO FREAKING IDEA of what the target audience is. A RAID5 review would be much more appropriate. Hate to lose 100GB of data nowadays...let alone 2TB, at that point, you might as well kill yourself
  • Gary Key - Thursday, April 19, 2007 - link

    We have a full RAID article in the works that will test RAID 1, RAID 1+0, and RAID 5 with several drives, Intel and NV chipsets, along with hardware controllers. As I mentioned in the article, this story will be up in the coming weeks. As far as offering RAID 0 results with a motherboard controller chipset, this was done as the vast majority of boutique systems offer this option along with several hundred emails asking when we could provide RAID 0 results with the latest drive releases.

Log in

Don't have an account? Sign up now