The New Test Suite

As we mentioned at the beginning of this article, we are introducing a brand new test suite with this review and we are also kicking off the first installment of a multipart series covering multiple aspects of current (and somewhat next) generation gaming performance.

By no means should you take the limited (yet extensive) tests we have here as all you will see from us, but rather something to whet your appetite for what is yet to come. The focus of this review is plain and simple – comparing the basic performance of the latest offerings from ATI and NVIDIA. In the future installments we will cover image quality, CPU scaling and other aspects of performance in greater detail. We will be making notes of noticeable visual differences between ATI and NVIDIA in this article, but a comparison with supporting images will be done in Part II of the series.

As far as the new test suite is concerned, here are the benchmarks that made it in:

AquaMark 3
Command & Conquer Generals: Zero Hour
F1 Challenge ’99-‘02
Final Fantasy XI Benchmark 2
Halo
Homeworld 2
Jedi Knight III: Jedi Academy
Microsoft Flight Simulator 2004
Neverwinter Nights: The Shadows of the Undrentide
Simcity 4
Splinter Cell
Unreal Tournament 2003
X2
Warcraft III: Frozen Throne
Wolfenstein: Enemy Territory

We are working on expanding the suite even further, but for now this is what we have. If you’d like to see more games added please feel free to let us know either by sending an email or even better, leaving a comment through the system at the bottom of the page.

We used ATI’s publicly available Catalyst 3.7 drivers and in order to support the NV38 we used NVIDIA’s forthcoming 52.14 drivers. The 52.14 drivers apparently have issues in two games, neither of which are featured in our test suite (Half Life 2 & Gunmetal).

Our test bed was configured as follows:

2.8GHz Intel Processor Prescott
512MB DDR400
Intel 875P Motherboard

The Radeon 9600XT & NV38 Aquamark 3
Comments Locked

263 Comments

View All Comments

  • Anonymous User - Thursday, October 2, 2003 - link

    I wouldn't mind seeing Medieval Total War in the test group. Maybe use a huge battle and replay it using all the different cards. Thanks for including Command and Conquer it helped me pick my card.
  • Anonymous User - Thursday, October 2, 2003 - link

    Quote:
    The picture quality in UT2003 has been the reason for some of the criticism against nVidia recently. nVidia has chose to lower the picture quality in this game when it concerns anisotropic filtering. Most clear we see nVidia's lower picture quality in the 51.75-driver when AF is activated in the control panel.


    Quote:
    The major difference in picture quality in WC3 is the anti aliasing. Due to some reason it seems like nVidia's cards have problems with horizontal edges in this game above anything else. Check i.e. the large log in the fire; it looks like it is principally without AA.



    Quote:
    It maybe gets rather boring to hear (read), but we can not lie; ATi's high quality FSAA win over nVidia once more. As we can see Detonator 51.75 is totally out of the game when it seems like AF is being disabled.


    Quote:
    Once more ATi takes the lead, 9800 Pro gets along this time too. Detonator 51.75 lowers (once more) the quality of texture filtering.


    Quote:
    Radeon kicks some ass in BF1942, nVidia doesn't stand a chance. Once again, Detonator 51.75 lowers the texture quality so much that we don't find the results comparable.


    Quote:
    ATi rips nVidia into pieces in Tomb Raider. If this is an indication of upcoming DirectX9 performance (and it seems like that when looking at Half Life 2 tests) nVidia won't have a lot to say the coming 6 months. Detonator 51.75 increases performance, but also causes some strange bugs.

    nVidia's present drivers doesn't allow for floating point precision for render targets etc. resulting in lower quality. Detonator 51.75 also makes the Depth Of Field effect to run amok. The main character is repeatedly erased, despite the fact that the effect is supposed to erase things the longer away they are, for example. As expected, AA works better with ATi's card. Anisotropic filtering also looks better on ATi's card, since this kind of filtering causes ""texture aliasing" (floating pixels) on nVidia's cards.

    Subjective analysis: There's no question about it, nVidia's card isn't even close to being playable. Despite that, ironically, Tomb Raider is part of nVidia's so called "The Way It's Meant To Be Played" program. I noticed no differences between XT and Pro when playing the game.


    Quote:
    It's a bit strange to see that ATi's image quality and performance increases when we apply AF through the application instead of from the control panel. On the mountain in the very middle of the picture it's clear that the image quality once again is better with ATi's card.

    Subjective analysis: I am very confused with the test results from Jedi Academy. The strange thing is that the game runs a lot better (and looks better) on the ATi card, but in the performance tests it seems like if nVidia beat the 9800 Pro, which doesn't reflect the impression we got when actually playing the game.


    Quote:
    If we take a look at the 3DMark03 performance with Detonator 51.75 we can see that it has been given a good increase. Although we have great suspicions that these optimizations are more or less exclusively application specific, and that it might be optimizations that is by a nature that is not applicable on a real game. Therefore we have chosen to give 51.75 a gray pillar because we don´t believe it is giving an accurate result.

    With Detonator 44.03 that is "approved" by Futuremark you can see that nVidia really has not got a chance against ATi's cards. As said: nVidia says it is misleading, but all of the DX9 games so far shows that Futuremark actually succeeded in creating a pretty good prophecy with their 3DMark03.

    If we take a closer look at the even more synthetic Pixel Shader 2.0-test we see that the FX-card's weak spot is DX9.


    Quote:
    We got very weird results in Aquamark 3. nVidia's Detonator 44.03 shows a very low performance, but the driver generates an output that is completely approved Detonator 51.75 on the other hand has noticeable losses of picture quality on a couple of areas: Mist/smoke has been heavily reduced in at least one scene, texture filtering is a lot worse, some things look like the are rendered with lower precision, and finally many lightning effects are a little suspect or not even there. Right now under these circumstances we can only point away from the results from detonator 50. And under those circumstances ATi has an unbelievable lead ahead nVidia.


    http://www.nordichardware.com/reviews/graphiccard/...
    _________________
  • Anonymous User - Thursday, October 2, 2003 - link

    I would like to see Battlefield 1942 as a test game, it is one of the more popular games out there right now.
  • Insomniac - Thursday, October 2, 2003 - link

    If it is a Prescott, it isn't any better than the current Northwood P4. I base this on the Athlon 64 article. Anand used a Radeon 9800 Pro 256 MB in it and the only benchmark I see on both is the UT 2003 Flyby. For both articles he used the Catalyst 3.7. So taking the numbers:

    2.8 GHz Intel Processor (Prescott whited out): 212
    Intel Pentium 4 3.2C: 232.8
    Intel Pentium 4 3.0C: 226.3

    The 3.0C is faster than the 2.8 by 6.7%
    The 3.2C is faster than the 3.0C by 2.9%

    I would expect a 2.8C to score closer to 220.

    Of course, that is only one benchmark. I wonder what is going on. Throw us some information Anand! :)
  • Anonymous User - Thursday, October 2, 2003 - link

    I did.
  • Anonymous User - Thursday, October 2, 2003 - link

    the inq noticed this. anybody did?

    highlight the following words:
    featured in our test suite (Half Life 2 & Gunmetal).

    Our test bed was configured as follows:

    2.8GHz Intel Processor
    512MB DDR400
    Intel 875P Motherboard

    then it will show up as:
    featured in our test suite (Half Life 2 & Gunmetal).

    Our test bed was configured as follows:

    2.8GHz Intel Processor Prescott
    512MB DDR400
    Intel 875P Motherboard

    meh...
  • Anonymous User - Thursday, October 2, 2003 - link

    lol

    i dont think some of you morons have read the entire 9 pages of posts.
    you slackers ! :)
  • Icewind - Thursday, October 2, 2003 - link

    Im excited to get my 9800XT. I got a 4200 in Sept 2002 cause UT2k3 and BF1942 ran like crap on my firt gen Geforce 3, It only cost me $178 and I modded it for better cooling and ran it at near 4400 speeds. Now im quit tired of the slowdowns in BF942 and UT2k3 as I want higher res and my effects cranked up, and I also want to run Half Live 2 in all its glory. I work my ass off at work and I feel like getting a $500 card, that is my choice, period.
  • Anonymous User - Thursday, October 2, 2003 - link

    <b>How about adding one more video card? a GF4ti4x00 </b>
    SO MANY people have these cards and I for one would like to see a comparison of what I would have to gain from upgrading.
  • Anonymous User - Thursday, October 2, 2003 - link

    [b]How about adding one more video card? a GF4ti4x00 [/b]
    SO MANY people have these cards and I for one would like to see a comparison of what I would have to gain from upgrading.

Log in

Don't have an account? Sign up now