Retina display! 8-megapixel camera! Video calls! HDMI port! The last few days have seen lots of shouting from proponents of the hot phones of the minute, the Apple iPhone 4 and Motorola Droid X. Which phone really delivers the best experience? We got our hands on both and tested them in eight categories: cost of ownership, storage, connection speeds, still and video image capture, display and resolution, operating system and multitasking, media playback and processor power.
The iPhone 4 won the majority of our battles--but barely. Both phones are incredibly fast, have superb displays and come loaded with multimedia features. Some of our tests however, like OS and media playback, really come down to personal preference. On the other hand, our display, still camera and camcorder tests clearly prove that the iPhone 4 is stronger in these categories. And the iPhone won our data speed and voice quality tests, though these were confined to San Francisco. The results could be different in other parts of the country.
Soon, we'll be putting the HTC EVO 4G as well as the Samsung Galaxy S through the same testing, so check back for those results.
Meet the Contenders
At this point, you've probably become pretty familiar with the iPhone 4 (available now on AT&T; $299 for 32GB, $199 for 16GB, both with a two-year contract) and the Motorola Droid X (available July 15 for $200 on Verizon, also with a two-year contract), but here's a quick refresher. The Droid X's standout features include a 4.3-inch display, an 8-megapixel camera, HDMI and DLNS connectivity and a 1 GHz TI OMAP processor. The iPhone 4's headlining features include its "Retina display," an improved 5-megapixel camera and a front-facing video camera for video calls, and HD (720p) video capture. To see how the specs stack up against each other, take a look at our comparison chart (click to enlarge).
Connectivity: Data Speeds and Voice Quality
The Stats: In the connectivity department, the Droid X and the iPhone 4 both come with Wi-Fi, GPS, and Bluetooth. What the Droid X can do and the iPhone 4 can't is to act like a mobile hotspot. For an extra $20 per month, the Droid X allows you to connect up to five compatible Wi-Fi devices to Verizon's network, such as your laptop, your iPad, or other gadgets.
Both phones boast noise cancellation technology, which is supposed to improve call quality by blocking other sounds around you except your voice.
Testing Methodology: We tested the iPhone 4 and the Droid X in five San Francisco locations and used the same testing methodology we use for our 3G speed tests. We use the FCC-endorsed Ookla testing tool app running on both the iPhone 4 and the Droid X to measure upload speeds and download speeds. The Ookla test sends a stream of packets from the phone to a network server and back, then measures the average speeds at which the packets make the round trip. We ran three consecutive speed tests on each phone at each location and then picked the best upload and download speeds of the three. Our voice call tests were more subjective; we placed calls to a common local number, listening for static, jitter, delay, dropped calls or failure to connect, then assigned a score to each call.
Data Speed Winner: iPhone 4
In our informal performance testing in San Francisco, the AT&T-connected iPhone 4 registered far faster download speeds than the Verizon-connected Droid X. The iPhone 4 showed an average download speed of 1958 kbps (almost 2 mbps) across our five testing locations in the city. The Droid X had an average download speed of 1130 kbps - still more than enough speed for reasonably fast web browsing and standard-definition video watching. The two new devices registered similar average upload speeds; the iPhone4 registered 434 kbps and the Droid X averaged 564 kbps. These upload speeds are fast enough to support basic file sharing but are not fast enough to make fat-pipe apps like multi-player gaming or video conferencing run well.
Voice Quality Winner: iPhone 4
The iPhone 4 showed an even greater advantage over the Droid X in our voice call quality tests. In almost all test calls placed around the city, calls on the iPhone sounded better than the Droid. Calls sounded more natural and were more pleasing to listen to on the other end of the line. We recorded no dropped calls on AT&T.
In test calls using the Droid, the sound coming out of the earphone was usually clear enough, but it didn't sound as full and pleasing as that coming out of the iPhone 4. On the other end, I'm told, my voice sounded loud enough, but not as dynamic and even a bit shrill. We also noted some minor static on some calls, as well as a warbling sound in other calls. We recorded only one dropped call using the Droid.
Obviously, you can't generalize too much from these tests. We were only able to test in one city and testing over wireless networks is inherently unpredictable - weather and network traffic can affect the results in unknown ways.
Total Cost of Ownership + Storage
Before we start comparing the specs and testing the features, let's take a look at a breakdown of the cost of owning the phones. We looked at both the most inexpensive voice and data plans as well as the most expensive plans for each phone to see how they compare. (Click to expand.)
Conclusion: With the cheapest options, Droid X costs about $360 more over two years than the 16GB iPhone 4, but the Droid plan includes unlimited data, compared to 200MB for the iPhone.
With the high-end options for both, the Droid costs $120 more over two years. The Droid plan includes unlimited data, while the iPhone's data is capped at 2GB per month (though, to be fair, few users will exceed the 2GB limit).
You should also consider how much storage you're getting for your money. The iPhone 4 only comes in 16GB and 32GB models, like the previous 3GS generation. As we all know too well, the iPhone 4 does not have expandable storage. The Droid X on the other hand, has 8GB of storage built-in, and comes with a 16GB microSD card in the box. And because the Droid X supports microSD cards up to 32GB, you can extend its storage up to 40GB.
Winner: Droid X. Total cost of ownership is not significantly more and you get a larger data allowance and the potential for more storage capacity.
The Specs: The iPhone 4 sports a 5-megapixel camera sensor with an LED flash, which is a nice upgrade from the iPhone 3GS's 3-megapixel snapper with no flash. The camera supports tap-to-focus in shooting mode as well as photo geotagging.
On paper, the Droid X's camera seems a bit stronger. It has an 8-megapixel display with a dual-LED flash. There's no tap-to-focus, but there is a face-detection feature that will automatically focus on a (human) subject. In addition to an Auto mode, the Droid X has a handful of basic scene modes that you can adjust based on the shooting environment: Landscape, Portrait, Macro, Sports, Steady Shot, Sunset, and Night Portrait.
Testing Methodology: The PCWorld testing methodology for the iPhone 4 and Droid X's cameras is a truncated version of our regular testing methodology for point-and-shoot cameras. We affixed each phone to a tripod and shot two images with the flash turned off:
1. One still-life scene with a color chart and delightful random objects to rate exposure quality and color accuracy.
2. A target chart and printed text to evaluate sharpness and distortion levels.
Here are the still life shots from the iPhone (left) and Droid:
Below are the text and target charts, again with the iPhone on the left:
The Winner: iPhone 4. Here's evidence that megapixel counts rarely matter: Apple's 5-megapixel iPhone 4 beat out the Droid for overall image quality in our tests, serving up well-exposed, brightly colored images in our lab tests. However, the iPhone 4's image quality did lag behind the competition in two categories: sharpness and visible distortion. The 8-megapixel Droid X scored closely behind the iPhone 4 in all tests, however and even beat the iPhone 4 in our sharpness tests.
The Specs: Both the iPhone 4 and the Droid X boast HD (720p) video recording up to 30 frames per second with audio. The iPhone's tap-to-focus for still photos also works with video. And of course, the iPhone 4 also has the front-facing video camera; switching between the two cameras is as simple as tapping an icon in the upper right-hand corner. The Droid X's camcorder has three microphones allowing you to choose from four different audio recording modes: Everyday, Outdoors, Narrative and Subject. You can also use the flash as a light if you're recording at night or in a dark environment. The Droid X also has a handful of shooting effects like a sepia tint, black and white, negative and more.
Testing Methodology : We tested the camcorder capabilities of the iPhone 4 and Droid X's in the same way we test pocket digital camcorders. Tony Leung in our Lab records a 1-minute video of a toy train and Ferris wheel to gauge several aspects of the video quality: smoothness of motion, color accuracy, and artifacting. We shoot the same scene twice, with each camera in the same tripod location at its highest video-quality setting: once in bright indoor lighting, and again with the overhead lights turned off and a floor lamp turned on behind the camera. Once we've shot all of the footage, our panel of judges rates each clip for its overall quality. We also play an audio clip through speakers in the scene to determine how well each camera picks up sound.
The Winner: iPhone 4. The iPhone 4 walloped the Droid X in our camcorder tests. It scored significantly higher in our video tests shot in regular lighting and tests shot in low light. The Droid X and iPhone 4 earned identical scores for audio quality, however. Overall, the iPhone 4 earned an overall word score of "Good" while the Droid X earned an overall word score of "Fair" for video quality.
Display and Resolution
The Specs: The iPhone 4 has a 3.5-inch, 960-by-640-pixel display with "Retina display" technology. What, you might ask, is a "Retina display?" According to Steve Jobs, it is a display that has a resolution that either meets or exceeds the maximum resolution the human retina is capable of resolving, assuming perfect vision. But there's some debate over whether the iPhone 4's display is a true retina display; read what our colleague at DisplayMate had to say about Apple's claims.
The Motorola Droid X sports a 4.3-inch screen--a whole 1.2 inches larger than the iPhone 4's display. But its resolution is lower: 854 by 480 pixels.
Testing Methodology: I did some side-by-side comparisons. I set both phones to their maximum brightness setting and loaded PCWorld.com on both. I placed both side-by-side and didn't zoom in at all. I asked various PCWorld editors to look at the text and pick which display was more readable. You can judge for yourself with the photo below -- the iPhone is the smaller display at top. (Click to enlarge.) But keep in mind that the differences are more marked and easier to see in person.
The Winner: iPhone 4. The bigger the better? Not in this smackdown. The contrast in quality between the iPhone 4's display and the Droid X's was astounding. Text on the iPhone appears sharper, the white background is brighter and the black text is blacker than the Droid X. Because the text without zooming is barely legible on the Droid X, we're guessing that the Droid X's browser does not do subpixel rendering. I do like the Droid X's extra screen real estate, especially when it comes to browsing and video watching, but there's no arguing that the iPhone 4 has a sharper, brighter display.
Operating System: iOS 4 vs. Android 2.1 with MotoBlur
The Specs: The iPhone 4 ships with iOS4, the latest version of the iPhone operating system. Aesthetically, iOS4 looks similar to iOS3 but there are a couple of major new features. The biggest update, of course, is the addition of multitasking. We've covered iOS4 extensively since its announcement, but take a look at our breakdown of its best features.
Unfortunately, the Droid X does not run the latest version of Android, Android 2.2 (aka Froyo). You're stuck with 2.1 until later this summer when Droid X (and hopefully other Droid phones on Verizon) get the 2.2 update. The biggest difference between 2.1 and 2.2 is a boost in performance.
The Droid X has Motorola's custom skin, Motoblur, running over Android. Other than making Android a little easier on the eyes, this version of Motoblur features two widgets that can show the latest updates to your social networks, like Facebook or Twitter. Another new feature is a navigation bar that lets you quickly switch between your various homescreens without having to flick through all of them to get to what you want.
Testing Methodology: Most aspects of phone OSes are extremely subjective. Some Android phone owners find iOS simplistic and limited. Many iPhone owners think Android is messy and unappealing. So trying to deliver a verdict on the OSes as a whole is a fool's errand.
But we did look closely at multitasking, an emerging area where it's easier to compare the two approaches. And the comparison is striking.
Apple's approach is typically, well, Apple-like. Apple has more control over the multitasking experience--only apps that have been designed and approved for multitasking will work. And at the moment, the number of apps that support multitasking is extremely limited.
But the interface is smooth and intuitive. Double-tap on the home button to call up the multitasking bar, which appears at the bottom of the menu screen just up from the home button. The bar shows four icons across the bottom of the screen at a time, the most recently opened apps will have icons starting at the left; flick your finger left to right to scroll through the other icons (the one furthest stage right being the one opened the earliest). If you want to close an app out of memory, you press and hold the app's icon, and then click the red circle with a dash.
The Android approach is more wide-open, but harder to navigate. Android will keep other apps actually running in the background, and not just in a suspended state as iPhone does. For example, in Android a Web page might continue drawing, even after you have left the browser to do so something else.
To see your open apps, you can press and hold the home button. But wait-you can only view six open apps at a time! Unfortunately, the only way to see all of the apps running at any given time is to dig down into the Settings/Applications/Manage applications. Once there, you must then scroll down to Controls and press Force stop to close the app.
You can, however, download a third-party app, like Advanced TaskKiller for example, to make viewing and closing open apps easier. For some users, this might be a burden-why can't you view all of your open apps by simply pressing a button ala iOS4? On the other hand, some users enjoy having this sort of control and customization over their phone and the Android platform's openness certainly allows that.
Winner:Draw. It really comes down to personal preference.
The Specs: According to Apple, the iPhone 4 has an audio frequency response of 20Hz to 20,000Hz. It supports AAC, Protected AAC (DRM-protected content from iTunes), HE-AAC, MP3, Audible, Apple Lossless and WAV. In terms of video, the iPhone supports H.264 video up to 720p, MPEG-4 and Motion JPEG formats.
The Droid X supports MIDI, MP3, WAV, AAC, AAC+ and eAAC+ audio files. It supports HD playback via its HDMI and DLNA ports as well as H.263, H.264, MPEG-4 and WMA video formats.
Testing Methodology: I didn't have time to run PCWorld's audio tests to judge the Droid X and iPhone 4's audio quality so I did some very casual testing. I loaded the same MP3 on both phones ("Fazer" by Quicksand) and listened with my own V-Moda Remix Remote earbuds. I also played the song back through the external speakers on each. I also asked my PCWorld colleagues to give their feedback for the song on each phone.
Video was tougher to subjectively test. I couldn't fairly compare YouTube videos because the iPhone does not have the HQ feature in YouTube (on Droid X's YouTube app you get a feature called HQ that enables you to watch better-quality videos if they are available). Even so, I compared the same "Despicable Me" trailer on YouTube on both phones. I also had a hard time finding one H.264 file that would play back on both phones. I downloaded a couple of trailers via iTunes and rented a couple of HD movies to play on the iPhone 4. On the Droid X, I downloaded a few H.264 format movie trailers from h264info.com. For whatever reason, I couldn't get the Blockbuster application on the Droid X to work so I couldn't rent any feature-length movies.
The Winner: Droid X for Audio. Draw for Video. It was a close call, but my colleagues and I unanimously picked the Droid X over the iPhone 4 for better sound quality. Bass sounded deeper while vocals sounded crisper and richer over the Droid X. We noted a slight tinny quality during playback over iPhone 4, but everyone agreed that sound quality was still quite good.
Video was harder to judge since I couldn't play the exact same file on both phones. When HQ is available, video playback via YouTube on the Droid blows the iPhone out of the water. If you watch a lot of YouTube videos, this is something you might want to consider. Then again, it was incredibly easy to download movies onto the iPhone via iTunes directly on your phone. Using a third-party Web site like h264info.com is risky, not to mention time consuming. Playback on both phones was smooth with no stuttering, pausing or pixelation present. And while quality looked better on the iPhone (see our displays comparison), I really appreciated the larger screen for video on the Droid X. My eyes felt more comfortable watching videos on the larger screen where faces and objects are larger (though not higher resolution). On the iPhone's 3.5-inch display, I had to strain my eyes a bit.
The Specs: The iPhone 4 runs on the same A4 chip found in the iPad, but Apple has not disclosed its clock speed (though in the iPad, it's 1GHz). The Droid X has the first TI OMAP 3630 1 GHz processor.
Testing Methodology: To test the processor, I timed how quickly each phone downloaded a blank e-mail message with a 1MB .JPG attachment over Gmail. I did this test three times on each phone.
The Winner: Droid X-at least in this test. The Droid X had an average time of 7.3 seconds to download the attachment while the iPhone 4 took slightly longer at 10 seconds. Really, both phones are fast. This is just one example of an area where the Droid X is slightly faster.
Senior editors Tim Moynihan and Mark Sullivan contributed to this report.
This story, "iPhone 4 vs. Droid X: A Head-to-Head Comparison" was originally published by PCWorld.