Weekly internet health check, US and worldwide

ThousandEyes, which tracks internet and cloud traffic, provides Network World with weekly updates on the performance of three categories of service provider: ISP, cloud provider, UCaaS.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Page 8
Page 8 of 19

On April 27, Telecom Italia Sparkle experienced an outage that impacted some of its partners and customers in countries, including, the US, China, New Zealand, Canada, Japan, France, Italy, the UK, Germany, Brazil, Japan, Turkey, Nigeria, India, Hong Kong, Sweden, Republic of Korea, and Austria. The 23-minute outage was first observed around 6:25 p.m. EDT and appeared to center on nodes in Ashburn, Virginia. Five minutes into the outage nodes in Milan, Italy; Frankfurt, Germany; London, England; and Sao Paulo, Brazil, exhibited outage conditions. Twenty minutes after being observed, many of the nodes appeared to recover, leaving just nodes located in Milan and Frankfurt exhibiting outage conditions. The outage was cleared around 6:50 PM EDT. Click here for an interactive view.

Update April 18

Global outages across all three categories last week rose from 269 to 297, a 10% increase. In the US, outages increased from 97 to 110, up 13%.

Globally, ISP outages increased from 158 to 209, up 32%. while in the US they increased from 54 to 88.

Globally cloud-provider outages decreased from 11 to eight, but in the US increased from two to six.

Globally, collaboration-app network outages increased from 22 to 24, up 9%, and in the US they dropped from 15 to six.

On April 13, a Hurricane Electric outage impacted customers and downstream partners across regions including the US, Colombia, Israel, Greece, Costa Rica, Canada, and Germany. The outage, first observed at around 2:51 a.m. EDT, lasted 23 minutes and appeared to center on Hurricane Electric nodes located in Miami, Florida and Paris, France. Five minutes into the outage, the nodes located in Paris, France appeared to recover, and nodes located in San Jose, California, exhibited outage conditions. Five minutes after appearing, the San Jose nodes lalso appeared to clear and nodes in Ashburn, Virginia, and Chicago, Illinois exhibited outage conditions. The outage was cleared around 3:15 a.m. EDT. Click here for an interactive view.

On April 12, Oracle experienced an outage that impacted customers and downstream partners interacting with Oracle Cloud services in countries including the US, Japan, Canada, the United Arab Emirates (UAE), India, Germany, the UK, the Netherlands, Brazil, the Republic of Korea, the Philippines, and Australia. First observed at around 8 a.m. EDT and lasting a total of 38 minutes, the outage consisted of two occurrences over a 45-minute period. The first initially appeared centered on Oracle nodes in Toronto, Canada. After 10 minutes, nodes in Montreal and Mississauga, Canada; Chicago, Illinois; Dubai, UAE; Tokyo, Japan; Sydney, Australia; and London, England exhibited outage conditions. After 30 minutes into the first occurrence, only Toronto, Kitchener, and Sydney still exhibited outage conditions. At around 8:35 AM EDT, the outage appeared to clear about 8:35 a.m. EDT, but five minutes later, Toronto nodes once again appeared to exhibit outage conditions. The outage was cleared around 8:45 a.m. EDT. Click here for an interactive view.

 

Update March 28

Global outages across all three categories last week increased from 216 to 234, up 8%, while in the US they increased from 82 to 99, up 21%.

Global ISP outages increased from 153 to 169, up 10%, and in the US they increased from 61 to 74, up 21%.

Global cloud-provider network outages increased from nine to 15, while in the US they increased from six to nine.

Global collaboration-app network outages increased from nine to 10 outages and in the US they remained at six.

There were two notable outages during the week.

On March 21, Hurricane Electric experienced an outage that impacted customers and downstream partners across multiple regions including the US, Canada, Nigeria, Australia, Malaysia, Germany, China, Denmark, Egypt, Norway, Japan, and Belgium. The outage was observed around 7:10 p.m. EDT, and lasted 37 minutes in two occurrences over an hour and 20-minute period. The first occurrence centered on nodes in Dallas, Texas and appeared to mainly impact the US and Canada. Forty minutes after this first outage cleared, the second outage was observed centered on nodes in London, England. Five minutes into the second occurrence, the London nodes recovered and nodes in San Jose, California, exhibited outage conditions for the next 10 minutes. Twenty minutes into the second occurrence, the San Jose nodes appeared to clear and nodes in New York, New York, exhibited outage conditions. The outage was cleared at around 8:20 p.m. EDT. Click here for an interactive view.

On March 22 Rackspace Technology experienced a series of outages over a period of an hour and 34 minutes that impacted downstream providers and customers in the US. The 51-minute outage was first observed around 2:40 p.m. EDT centered on Rackspace nodes in Chicago, Illinois. Thirty-four minutes later, the Chicago nodes appeared to recover. Forty minutes after first being observed, Chicago nodes once again exhibited outage conditions over a series of five short-duration outages before clearing around 4:25 p.m.EDT. Click here for an interactive view.

Update March 21

Global outages across all three categories last week increased from 210 to 216, a 3% increase compared to the week prior. In the U.S., outages increased from 66 to 82, a 24% increase.

Globally, ISP outages decreased from 159 to 153, down 4%, while in the US they increased from 49 to 61, up 24%.

Globally, cloud-provider network outages increased from seven to nine and doubled in the US from three to six.

Globally, collaboration-app network outages increased from five to nine, and from three to six in the US.

There were two notable outages during the week.

On March 16, Arelion experienced an outage that impacted customers and downstream partners across multiple including, the US, Brazil, Australia, Canada, India, and Germany. The disruption lasted a total of 28 minutes, divided into two occurrences over a 35-minute period. First observed around 3:30 a.m. EDT, the first occurrence lasted 24 minutes and appeared to center on nodes in Dallas, Texas. Five minutes later some of the nodes appeared to recover, reducing the number of downstream partners and customers impacted. Around 3:55 a.m. EDT, the remaining nodes appeared to recover. Five minutes later the Dallas nodes exhibited outage conditions. The outage was cleared around 4:05 a.m. EDT. Click here for an interactive view.

On March 17, Cogent Communications experienced an outage that impacted multiple downstream providers as well as Cogent customers in countries including the US, Argentina, Brazil, Australia, Spain, and Canada. The 14-minute outage was observed around 5:00 a.m. EDT centered on Cogent nodes in San Francisco, California. Five minutes later, nodes in Los Angeles and Rancho Cucamonga, California, also exhibited outage conditions. As the nodes impacted increased, so did the number of customer networks and providers impacted. After 10 minutes into the outage the Rancho Cucamonga nodes appeared to recover and nodes in San Jose, California, exhibited outage conditions. The outage was cleared around 5:15 a.m. EDT. Click here for an interactive view.

Update March 14

Globally, the number of ISP outages decreased from 191 to 159,  down17%,] and in the US were down from 80 to 49, a 39% decrease.

Globally, cloud-provider network outages remained at seven for the third week in a row but dropped from six to three in the US.

Collaboration-app network outages remained at five worldwide and at three in the US.

There were two notable outages during the week.

On March 8, Google experienced a disruption that affected Google Traffic Director customers. Observed around 1:07 p.m. EST, multiple applications, such as Spotify and Wikipedia, returned HTTP 500 server errors for some users, indicating the presence of a backend issue, and appearing to affect Google customers who used shared Virtual Private Cloud (VPC). Network connectivity to affected applications was clear during the incident, further confirming that the issue was application related. Google later confirmed that they had mitigated the issue by rolling back a recent configuration change and forcing a reprogramming of configurations. The disruption lasted 2 hours and 35 minutes and was cleared around 3:42 p.m. EST. Click here for an interactive view.

On March 9, Microsoft experienced an outage on its network that affected some downstream partners and access to services running in Microsoft environments. The outage, which lasted 19 minutes, was observed around 5:35 p.m. EST and appeared centered on Microsoft nodes in Des Moines, Iowa. Ten minutes later the number of affected Des Moines nodes appeared to rise, temporarily increasing the number of affected partners. The outage was cleared around 5:55 p.m. EST. Click here for an interactive view.

Update March 7

Global outages across all three categories last week dropped from 273 to 256, a 6% decrease compared to the week prior. In the US, outages decreased from 116 to 109, also a 6% decrease.

ISP outages globally decreased from 197 to 191, down 3%, and in the US, decreased from 95 to 80, down 16%.

Cloud-provider network outages remained at seven globally but increased in the US from two to six.

Globally, collaboration-app network outages decreased from 14 to 5, down 64%, but in the US they increased from two to three.

There were two notable outages during the week.

On March 3, Oracle experienced an outage that affected Oracle Cloud customers and downstream partners in countries including the US, Malaysia, India, Japan, and Hong Kong. The outage was observed around 6:15 p.m. EST and appeared to center on Oracle nodes in Phoenix, Arizona, and Sweden. Five minutes later, the Sweden nodes appeared to recover, limiting the impact to the US and Hong Kong. The outage lasted 10 minutes in total and was cleared at around 6:30 p.m. EST. Click here for an interactive view.

On March 2, Google experienced an outage affecting its customers and downstream partners in the US and Brazil. The outage was divided into two occurrences over 39 minutes, starting at 6:25 a.m. EST and centered on Google nodes in Omaha, Nebraska. Five minutes later, nodes in Des Moines, Iowa, also exhibited outage conditions, which coincided with an increase in the number of affected customers and partners. Around 6:35 a.m. EST, the Des Moines nodes appeared to recover. About 6:40 a.m. EST, nodes in Des Moines and Sao Paulo, Brazil exhibited outage conditions. The first occurrence, lasting 28 minutes, cleared around 6:55 a.m. EST.  Five minutes after appearing to clear, the Des Moines and Omaha began exhibiting outage conditions again. The outage lasted 32 minutes in total and was cleared at around 7:05 a.m. EST. Click here for an interactive view.

Updated Feb. 28

Global outages across all three categories increased from 205 to 273, up 33%, while in the US they increased from 87 to 116, also up 33%, compared to the week prior.

Globally, ISP outages increased from 156 to 197, up 26%, and in the US they increased from 70 to 95, up 36%.

Global cloud-provider outages dropped from eight to seven, and from four to two in the US.

Collaboration-app network outages increased from 10 to 14 worldwide, but they droppped from five to two in the US.

There were two notable outages during the week.

Around 9 a.m. EST on Feb. 22, Slack experienced disruption to its business-communication platform that lasted around 3 hours and 14 minutes and impacted users accessing its messaging services. During the interruption, a number of application-based errors were observed, indicating that network connectivity to Slack was intact, and the problem resided within the back-end architecture. This was later confirmed by Slack, which identified the cause as a configuration change that inadvertently led to a sudden increase in activity on the Slack database infrastructure. That left some databases unable to serve incoming requests. Slack applied a combination of rate limits and a temporary redirection of requests to replica databases, allowing the system to recover. The outage was cleared around 12:14 p.m. EST.

Around 10:06 p.m. EST on Feb. 24, PCCW experienced an outage impacting some of its ISP customers and networks in countries including, the US and China. It appeared to center on PCCW nodes located in Ashburn, Virginia, and was cleared around 10:20 p.m. EST. Click here for an interactive view.

Updated Feb. 21

Global outages across all three categories decreased from 271 to 205, down 24% from the week before, while US outages decreased from 119 to 87, down 27%.

Globally, ISP outages decreased from 191 to 156, an 18% decrease, and the US outages dropped from 96 to 70, a 27% decrease.

Cloud provider outages worldwide dropped from 10 to eight, and in the US from six to four. 

Globally, collaboration-app network outages decreased from 13 to 10, while in the US they increased from two to five.

There were two notable outages during the week.

On Feb. 17, Level 3 Communications experienced an outage that impacted multiple downstream partners and customers across the US for a total of 28 minutes, divided into two occurrences distributed over an hour and 35 minutes. The first occurrence was observed around 2:40 p.m. EST centered on Level 3 nodes in Salt Lake City, Utah. An hour and five minutes after appearing to clear, the Salt Lake nodes began exhibiting outage conditions again that lasted nine minutes. The outage was cleared around 4:15 p.m. EST. Click here for an interactive view.

On Feb.17, Oracle experienced an outage on its network that affected customers and downstream partners interacting with Oracle Cloud services in countries including the US, Hong Kong, Australia, and Brazil. The outage was observed around 3:05 p.m. EST centered on Oracle nodes in Phoenix, Arizona, and Sao Paulo, Brazil. Five minutes later, the Sao Paulo nodes appeared to recover, reducing the number of affected countries to the US, Hong Kong, and Australia. The outage lasted 18 minutes and was cleared around 3:25 p.m. EST. Click here for an interactive view.

Updated Jan. 17

Global outages all three categories last week increased from 225 to 271, up 20% while in the US they rose from 104 to 119, a 14% increase.

Related:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Page 8
Page 8 of 19
The 10 most powerful companies in enterprise networking 2022