Skip Links

Network World

  • Social Web 
  • Email 
  • Close

(Comma separation for multiple addresses)
Your Message:

Review: Who's got the fastest firewall?

Crossbeam, IBM win raw performance test; Juniper, Watchguard score on price/performance
By Joel Snyder and David Newman , Network World , 12/10/2007
  • Share/Email
  • Tweet This
  • Comment
  • Print

When we tested firewall performance as part of in our UTM firewall test we focused on how well the products would push inspected packets along with other UTM features, specifically intrusion-prevention systems and antivirus, turned on. However, many enterprise managers will use these devices primarily just as firewalls, and might be curious how fast they’d operate without UTM slowing them down.

Our initial test bed had been tuned for 1Gbps throughput, and eight of the 13 firewalls we tested blew right past the 1Gbps mark without UTM turned on. So, with the help of David Newman from Network Test, we outfitted the test bed with a 2.8Gbps capacity, and re-ran our firewalls through at that higher speed.


How we did it
Archive of Network World tests
Subscribe to the Network Product Test Results newsletter

This second round of testing employed the same product configurations used for the 1Gbps UTM test with two exceptions. WatchGuard and Secure Computing have long offered proxy-based firewalls, claiming higher security than simple packet filters although with a cost in performance. WatchGuard’s Firebox and Secure Computing’s Sidewinder have the flexibility to use either simple packet filters, a generic proxy or an HTTP-specific proxy for HTTP traffic. Since our tests were made using HTTP traffic, we tested all three scenarios and reported all three numbers for each product.

Tracking high-speed firewall performance
Follow-up firewall tests showed that when pushed to speeds faster than 2Gbps, the top raw performers are Crossbeam Systems and IBM. When cost is factored in, however, Juniper Networks' lower-end box and WatchGuard Technologies' Firebox Peak provide the best firewall price/performance punch.

Vendor Product Price as tested Raw speed (Mbps) Performance tuning notes
Astaro ASG 425a $30,600 243  
Check Point UTM-1 2050 $50,800 754  
Cisco ASA5540 with SSM-20 IPS module $53,500 662  
Crossbeam C25 running Check Point Secure Platform $99,000 2800 Maximum rate of test bed
Fortinet FortiGate 3600A $122,000 1240  
IBM System x3650 running Check Point Secure Platform $68,200 2800 Maximum rate of test bed
IBM ISS Proventia MX5010 $60,000 1403  
Juniper ISG-1000 $60,000 987  
Juniper SSG-520M $24,600 1420  
Nokia IP290 running Check Point Secure Platform $56,000 994

750
NAT disabled; using Nokia cluster
NAT enabled; using Nokia cluster
Secure Computing Sidewinder 2150D with IPS acceleration $87,500

1810

1030

826

Using packet filters for HTTP
Using generic proxies for HTTP traffic
Using HTTP proxies for HTTP traffic
SonicWall Pro 5060 $24,000 587  
WatchGuard





Price includes cost of a high-availability pair of devices, system and management software, management and one year UTM support subscription.
Firebox Peak X8500e $20,600 1340

471

385
Using packet filters for HTTP
Using HTTP proxies for HTTP traffic
Using generic proxies for HTTP traffic
Click to see: Chart of high-speed performance

Overall, we found that if you don’t want to turn on any of the UTM features, you can get outstanding performance with almost half of the boxes we tested running at more than gigabit speeds. Even better news is that some of those high-performance boxes (namely Juniper SSG-520M and WatchGuard’s Firebox Peak X8500e) are offered (we say almost) at a great price. (You can compare pricing for dozens of UTM products in our UTM Buyer's Guide.)

  • Share/Email
  • Tweet This
  • Comment
  • Print

Comments (6)
Login
Forgot your account info?

RE: Review: Who's got the fastest firewall?By Dr Bob Hacker on December 11, 2007, 9:34 amPerhaps you should add a subtitle: Who has the most expensive firewall. The Linux router project on a top end quad core white box with a solid state disk might amaze...

Reply | Read entire comment

"Who has the most expensive..."By Mrs. Jane Hacker on December 11, 2007, 3:22 pmYeah, a 39 cent patch cable also goes real fast. But we'd like the firewall to actually provide protection, eh? Not that iptables or ipfw doesn't, but... it doesn't....

Reply | Read entire comment

Being a Fortinet partner,By SabianX on December 13, 2007, 10:07 amBeing a Fortinet partner, I'm expecting their typical "We weren't told the real specs of the review or we would have included 15 other options and speedy add-ons...

Reply | Read entire comment

This is a test. ValeskaBy Anonymous on December 14, 2007, 10:28 amThis is a test. Valeska

Reply | Read entire comment

Fastest FirewallBy Anonymous on January 7, 2008, 12:42 amI would like the authors to test the latest firewall from SonicWALL. SOnicwall recently announced their new set of firewalls with multicore architecture. E7500/6500...

Reply | Read entire comment

SonicWALL 5500/6500/7500By Joel Snyder on January 21, 2008, 10:18 pmWe have a test of the 5500/6500/7500 in process. Unfortunately for us, the firewalls have specs that are faster than our test bed, so we are working with Spirent...

Reply | Read entire comment

View all comments

Add comment
Anonymous comments subject to approval. Register here for member benefits.
Have a NetworkWorld account? Log in here. Register now for a free account.

Videos

rssRss Feed