Performance in Tiger
The one thing that excited me more than anything else about getting and using Tiger was that everyone had lauded OS X for being the one OS that had improved in performance with every iteration. Being a Windows user, this was a complete reversal of my thinking - as each new iteration of Windows was an excuse for me to build a ridiculously powerful machine by my old standards, to feel even remotely at home under the latest version of Windows.But it would appear that I may have missed the boat, as performance in Tiger is a mixed bag. I'd say that overall performance in Tiger is an improvement over Panther, but there are some definite exceptions to the rule.
The biggest exception, from my perspective, is the fact that menu highlights always seem to just barely trail my mouse pointer in Tiger, whereas Panther kept up very well. At first, I thought that I was just imagining things, but then I set up a G5 test bed with two identical hard drives; the only difference being one drive had Panther while the other had Tiger. After booting them back to back, it's clear that my worries were founded. Tiger's menu highlight does seem to be slightly more laggy than Panther's.
Other areas of performance show definite improvements in Tiger, but what's interesting to me is that subjective performance impacts vary greatly (for me) depending on the type of system that I'm using. For this article, I used Tiger on four different modern day Macs: two Powermac G5 systems (dual 2.5GHz and dual 2.0GHz), one Mac mini and a 15" PowerBook G4.
Performance using Spotlight is pretty impressive on all three systems on which I've tried Tiger. On the mini and the PowerBook G4, it is definitely slower than the G5, thanks to their slower hard drives, but it is still fairly quick to search and bring up results. Spotlight on the G5 is lightning quick, although the results don't all pop up at the same time. Within a second, you have your entire list of search hits at the upper right hand corner of your screen. What's interesting here is that because Spotlight performance isn't something that I could quantify in Panther (since Spotlight obviously wasn't a feature of Panther), the PowerBook and mini feel slower in Tiger to me than they were in Panther. It's not because the OS is actually slower, but it's because my usage models have changed with Tiger - thus, putting more emphasis on fast hard disk performance. I'd also say that there's a pretty noticeable performance difference in Spotlight between the mini's 5400RPM 2.5" hard drive in comparison to my older PowerBook's 4200RPM 2.5" hard drive.
I/O performance appears to have improved by a noticeable amount in Tiger, especially on the G5. Disk accesses seem quicker, although I'm not certain if that's improvements to the disk side of I/O or if it is better at memory management, caching, or what. Regardless, those two areas of performance definitely improved.
There was a noticeable improvement in performance on the G5, with the biggest improvements being in UI performance. The UI seems a lot more responsive (especially at higher resolutions), scrolling is faster/smoother and the OS in general just feels a lot snappier. Scrolling performance throughout the OS has improved tremendously; it's not smooth enough to the point where I feel like I can enable the smooth scrolling option and get the same feel as I could on a PC, but performance is still definitely improved. My only complaint with UI performance continues to be the menu highlighting issue from earlier. It's not a show stopper, but it's definitely something noticeable.
Exposé performs basically identical to Panther under the new OS, regardless of what system I'm talking about. The Mac mini continues to have issues at higher resolutions, as Exposé stops being smooth and now even Dashboard is choppy on the mini. Again, the problem here is a sheer lack of video memory. I do hope that Apple updates the mini to include a better GPU as well as one with a larger local memory very soon, now that Tiger is out. So much of the beauty of the Dashboard is that you can access it so quickly and seamlessly, that when you get to use a choppy version of the feature, it does slightly ruin the effect of it.
Although Apple promises better battery life management on notebooks with Tiger, I didn't notice any major improvements during my multiple months with Tiger loaded on the PowerBook. Obviously, battery life improved over time, but I can't help but feel that even with the final version of Tiger, battery life is no better, and maybe even slightly worse (especially in sleep states) than Panther. I don't have any quantitative backing for these claims yet - it's just a feeling at this point.
The main thing to keep in mind is that all four of the systems I tried under Tiger performed, overall and at worst, no differently than under Panther. In many cases, there were some pretty hefty speedups that were definitely noticeable. I'd say the biggest performance gains that I noticed were on the G5 machines, despite spending more time with Tiger on the G4 based clients. If you have a G5 with enough video memory, Tiger and all of its new features should be smooth sailing for you.
I did perform some basic tests to see how Tiger stacked up to Panther in various performance categories. For these tests, I used a Powermac G5 dual 2.0GHz using a 250GB Maxtor MaXLine III SATA drive (each OS had their own drive with their own clean install of the OS).
Both Tiger and Panther took basically the same amount of time to start up, with Panther getting from pressing the power button to the desktop in about a second quicker than Tiger.
Panther | Tiger | |
System Startup in Seconds (Lower is Better) | 49.1 | 50.1 |
The Let1KWindowsBloom test times how long it takes to open 1000 windows:
Panther | Tiger | |
Window Creation Time in Seconds (Lower is Better) | 44 | 8 |
It's not the best test in the world, but it is interesting that there is an order of magnitude of performance improvement of Tiger over Panther. I'm not totally convinced that this isn't a bug with the test yet, however, so I wouldn't put too much faith in it just yet.
I wanted to see if Tiger improved the absolutely dismal Doom 3 performance of OS X:
Panther | Tiger | |
Doom 3 Frame Rate (Higher is Better) | 35.9 | 39.5 |
And although a 10% performance increase is nothing to scoff at, there's no getting around the fact that Doom 3 performance on the Mac is absolutely unacceptable. The average frame rates that I'm reporting here don't even begin to tell the full story. There's just far too much stuttering during the actual game for it to even be remotely playable. It looks like Tiger does improve gaming performance though.
For my final test, I ran a quick decompress test of a 140MB archive to see if I/O performance really improved in Tiger.
Panther | Tiger | |
Archive Extraction in Seconds (Lower is Better) | 22.93 | 21.5 |
Tiger boasted a 6% lower time, but what's interesting is that Tiger's time was much more reliable than Panther's. There were many occasions when Panther actually took significantly longer than Tiger, but the reverse was never true.
Benchmarking under OS X continues to be a pain, but there's an early try at quantifying the performance differences between Tiger and Panther. I can say, in confidence, that if you're a G5 user, you won't be disappointed. For G4 users, I can't say that the performance improvement was as drastic, but it definitely wasn't negative.
55 Comments
View All Comments
msva124 - Sunday, May 1, 2005 - link
>"Oh we have to support this obscure motherboard as well as this..Can you give an example?
downtowncb - Sunday, May 1, 2005 - link
I would say that Apple's software and hardware exist to further each other, not just the software selling the hardware.Apple creates hardware, and then develops software to run on it.
Apple develops software, and then creates hardware to run it.
Software is easier to write, less buggy, and faster if you know exactly which hardware it runs on. No "Oh we have to support this obscure motherboard as well as this...," etc. In that way, the software is #1 and the hardware is simply built to support it. You can sell computers without software, but Apple probably wouldn't survive if everyone had to install Linux on their machines themselves in order to do anything.
IMHO, the hardware and software support each other.
michael2k - Sunday, May 1, 2005 - link
WaltC:"While being winners in terms of Apple's short-term survival as company, Jobs' strategies have also resulted in Apple's reduction to merely a negligible status today in terms of computer market share percentages world wide. Indeed, look how much of Apple's present profit and revenue derives from the iPod, for instance, which is not a computer of any type. "
Um, you do know from 1985 until 1996 Steve Jobs had no presence at Apple? That he had his own companies, NeXT and Pixar to deal with? His strategies, if you want, were the following:
Release a simple, affordable, powerful, computer in 1984: Original Mac, which became a strong model of the computing industry for the next 21 years.
Release a powerful, modern, OS and computer in 1989: NeXTStep, which is now the foundation for Mac OS X and is now Tiger, and is AGAIN a strong model for the computer industry (Longhorn, Linux)
Create the world's most popular mp3 player, the iPod, in 2001: It's a computer in every sense of the word, with a display, input, storage, and output functionality. It's 'revolutionary' status is because it was the first, smallest, fastest, highest capacity (all at once) device, though there were smaller, with smaller capacities, or larger, with larger capacities, and none with faster upload or UI in 2001.
Again, as for why compare Longhorn to Tiger?
Because everything Longhorn WANTS to do, Tiger does.
Longhorn wants a DBFS, called WinFS, not due until next year. Tiger achieves 90% of that now, and by next year will be even better.
Longhorn wants better search, to be achieved with WinFS, not due until next year, when Tiger has Spotlight now.
Longhorn wants a 3d accelerated display layer, and is not due until next year. OS X has achieved that since 10.2 in 2002 (a small step with hardware accelerated compositing), now more fully implemented since 10.3 and 10.4 with 3d and 2d acceleration, and with even more to come by the time Tiger comes out.
Longhorn wants a 'modern' UI, which is not due until next year, where OS X has had it since 2001, with each year bringing out more usability and functionality to the UI (Dock, transparency, animation, Expose, Dashboard, etc).
Longhorn wants better security, again not due until next year, while OS X has it now, and since 2001
Longhorn wants a shell and CLI, again next year, while OS X has had it since 2001
You ask why we compare: I think it's stupid NOT to compare. Longhorn wants to be a 'next generation' OS, and it's prototype and model 'next generation' OS is available now, and has been for four years, in Mac OS X.
We're not the only ones comparing. As I said before, Allchin of Microsoft has made direct comparisons, to Microsoft's detriment.
WaltC - Sunday, May 1, 2005 - link
#25 "But what you forget is that every Mac that sells takes away a sale of a copy of Windows from MS."Conversely, every Windows PC sold, along with SUN boxes and various Linux boxes of all types, etc., takes away a Mac sale from Apple...;) Heh...;) Sort of sobering to think about it like that, isn't it? Kind of clarifies Apple's <3% world-wide market share, doesn't it?
#25 "Apple will sell more that a million more computers this year than they sold last year. That's over a million fewer copies of Windows sold. As well as less copies of windows software by MS and others. It also means more copies of MS Office for the Mac sold."
Oddly enough, again, your vision is distinctly tunnel. I would hope it is not your contention that Apple alone of all the PC makers is growing...because by your reasoning every sale they make takes an equal bite out of the Apple, doesn't it?...;) Every sale they make is not an Apple sale, is it?
#25 "It's just dumb talking about "balls". This is a business. Maybe you like to play chicken, but companies that like to stay in business don't."
Heh...;) Tell that to AMD--or any number of successful companies today...;) In 1998 almost every "analyst" alive was writing off AMD and declaring that AMD was all but finished. Intel was considered an unbeatable juggernaut. The past six years at AMD have put the lie to that sentiment convincingly, I think...;)
Launching the K7 at AMD took every bit as much balls as it did brains (after all, what good is a great idea if you lack the courage to follow it through?). AMD proved the prevailing wisdom that said Intel was unassailable dead wrong, and is living long and propsering as a result. Launching the K7 and following through with everything since that AMD has done took guts and confidence out of the yin-yang...;)
So what's the only thing stopping Apple from actually competing directly with MS on the OS front? Why, it's nothing more than the firm belief that if it does it will fail. And there you have it completely...
WaltC - Sunday, May 1, 2005 - link
#22 "The fact, "Jack", is that this is marketing and Apple does make nice hardware and a great OS for some people. And I do agree with some of your salient points. But for a company that "is not a direct competitor to MS", some of you guys sure seem to worry a lot about them."So the fact that it is "marketing" is supposed to make up for the fact that Apple likes to fantasize that it's "ahead" by comparing its shipping OSes with MS's future, unreleased, unfinished, non-shipping OSes? That's bizarre, since Longhorn isn't close to shipping, let alone close to being finished, and so what's there to compare? Seems like shadow boxing to me, but, well, that's just Apple for you.
Yes, I worry--but probably not for the reasons you suspect. I worry that Apple seems congenitally unable to understand that *most people* see right through this kind of delusional "marketing" and get turned off to Apple in the process. But they don't call Jobs the King of the RDF for nothing, do they?...;) I suppose that if the RDF was ever dismantled and discarded in favor of something real that Apple's market share just might rise precipitously. I worry that Apple itself doesn't appear to understand this to any degree whatever.
I mean--Jobs has known for decades that unlike Apple, MS is not a hardware company. Yet he seems constantly confused about precisely *who* his actual competitors really are (he also occasionally seems to see clearly enough to spot Dell and other companies)--and the result is that mostly under Jobs tutelage in the last decade Apple itself has survived at the expense of approximately 80% of the market share in the worldwide consumer computer markets that it held in 1995 and earlier (down from 10% to about 2%.)
While being winners in terms of Apple's short-term survival as company, Jobs' strategies have also resulted in Apple's reduction to merely a negligible status today in terms of computer market share percentages world wide. Indeed, look how much of Apple's present profit and revenue derives from the iPod, for instance, which is not a computer of any type. Subtract Apple's iPod revenue and profit from Apple's bottom line and you'll see the true picture of Apple as a computer company today. Seems to me there's plenty to "worry" about in that sense. But, then, the RDF has never afflicted me so I guess I "think different" in that sense...;)
WaltC - Sunday, May 1, 2005 - link
#23 "Uh... I should point out that the Apple Mac OS X pages don't have a single reference to Longhorn anywhere, AFAIK."As well they shouldn't...;) You tell me, then--why are so many others comparing a shipping OS from Apple with an unfinished, unreleased, non-shipping OS from MS? Sure beats me...;)
chennhui - Sunday, May 1, 2005 - link
#20 michael2k, It is true that gaming is not all, but a important part of computer experience. If you don't game, a P3 or G4 will probably does a good job overall.Most applications available for Mac is available for PC. In fact, I feel MS Office is faster in PC compared to Mac (thank to Bill). So obvious Mac or PC is just a matter a taste (and may be you game or not).
Jbog - Sunday, May 1, 2005 - link
To say every Mac and OS X sale takes away Windows sales, is like saying the number of illegal mp3 download equals to the lost revenue for record companies. One should consider the possibility that some buyers are not even interested in buying Windows machines and vice versa.The Slashdot article thread was amusing. The legal dispute between Apple and TigerDirect reminds me of the time when Spike Lee sued Spike Channel. He argued that people would think of him when they see Spike Channel. I think they eventually settled out of court.
mircea - Sunday, May 1, 2005 - link
#25 said:"But what you forget is that every Mac that sells takes away a sale of a copy of Windows from MS. Apple will sell more that a million more computers this year than they sold last year. That's over a million fewer copies of Windows sold."
I think your judgement is a little off. Every Mac sold will mean a x86 based PC not sold. And on all these PC's it might be that if they were sold it would have been equiped with a Linux OS or something proprietary just as well as an Windows OS.
If there is to talk about comparison then it would be about how Apple, a hardware company is able to create an OS that can compete on functionality with a company that works almost exclusively with software. So if something is unjust on this comparison is that Microsoft is unable to stand out head and shoulders above a company that solds primarly hardware.
P.S. I never owned or currently own a Mac. Only used it at school on a music score editing software (Finale 2005) that I own on PC as well.
msva124 - Sunday, May 1, 2005 - link
>But what you forget is that every Mac that sells takes away a sale of a copy of Windows from MS.Perhaps there are dual users who purchase macs in addition to, rather than in place of, their windows computers.