Search /
Docfinder:
Advanced search  |  Help  |  Site map
RESEARCH CENTERS
SITE RESOURCES
Click for Layer 8! No, really, click NOW!
Networking for Small Business
TODAY'S NEWS
Where's my gigabit Internet, anyway?
Americans cool with lab-grown organs, but not designer babies
IE6: Retired but not dead yet
Enterprise who? Google says little about Apps, business cloud services in Q1 report
DDoS Attackers Change Techniques To Wallop Sites
Can we talk? Internet of Things vendors face a communications 'mess'
AMD's profitability streak ends at two quarters
Michaels says breach at its stores affected nearly 3M payment cards
Exclusive: Google's Project Loon tests move to LTE band in Nevada
H-1B loophole may help California utility offshore IT jobs
How a cyber cop patrols the underworld of e-commerce
For Red Hat, it's RHEL and then…?
Will the Internet of Things Become the Internet of Broken Things?
Kill switches coming to iPhone, Android, Windows devices in 2015
Israeli start-up, working with GE, out to detect Stuxnet-like attacks
Galaxy S5 deep-dive review: Long on hype, short on delivery
Google revenue jumps 19 percent but still disappoints
Windows XP's retirement turns into major security project for Chinese firm
Teen arrested in Heartbleed attack against Canadian tax site
Still deploying 11n Wi-Fi?  You might want to think again
Collaboration 2.0: Old meets new
9 Things You Need to Know Before You Store Data in the Cloud
Can Heartbleed be used in DDoS attacks?
Secure browsers offer alternatives to Chrome, IE and Firefox
Linksys WRT1900AC Wi-Fi router: Faster than anything we've tested
/

Google's secrets

Related linksToday's breaking news
Send to a friendFeedback

Sign up to receive this and other networking newsletters in your inbox.

I recently spoke with an IT executive at one of the most popular Internet destinations for information searching on the Web, Google.com.

Jim Reese, chief operations engineer at Google, had some interesting and valuable insight to provide on how to make a Web site that handles a high volume of traffic function reliably and efficiently.

At Google, which has about 10,000 servers, network managers use a homegrown suite of tools that provide automated updates and routine maintenance to servers. In other words, IT folks don't have to take on the seemingly impossible task of hands-on management. Automation tools not only save time - and of course, labor costs - but they also address human error.

Reese says Web site managers should find ways to let computers do what they are best at - repetitive tasks. To bring home the lesson, he points out that a single line command by a network manager at Google's network operations center can send out an update to about 10,000 servers at four data centers.

" We wrote these tools based on simple Shell and Perl scripts and Python - all freely available, " Reese says. He adds that the company opted for open-source code and homegrown applications for server management after looking at a number of off-the-shelf products. " All of them failed in scaling to the number of servers we have. "

A few years ago, Google was attending to only a few thousand servers; it has grown that server farm five times over since. That point being made, Reese notes that network managers should seriously consider how well the tools they choose to buy or build will scale to meet their future needs.

Google has also chosen to run its own customized version of Red Hat Linux instead of Windows or Unix. Additionally, says Reese, the company has chosen to use generic " White Box " servers instead of brand name servers from a Tier 1 vendor.

Reese says the ability to run many boxes that it configures itself with industry-standard parts has a few advantages. Because the servers are relatively cheap, the company can run many of them and replace them easily. The vast number of servers protects against single points of failure on the network. The site could lose hundreds of servers with little, or no effect on site performance.

RELATED LINKS

April Jacobs is a Senior Writer with Network World. If you have any comments or questions on this or other Web Acceleration newsletters, e-mail April at aprilj@nww.com.

VBrick adds Windows Media support
Network World, 09/10/01


NWFusion offers more than 40 FREE technology-specific email newsletters in key network technology areas such as NSM, VPNs, Convergence, Security and more.
Click here to sign up!
New Event - WANs: Optimizing Your Network Now.
Hear from the experts about the innovations that are already starting to shake up the WAN world. Free Network World Technology Tour and Expo in Dallas, San Francisco, Washington DC, and New York.
Attend FREE
Your FREE Network World subscription will also include breaking news and information on wireless, storage, infrastructure, carriers and SPs, enterprise applications, videoconferencing, plus product reviews, technology insiders, management surveys and technology updates - GET IT NOW.