Weekly internet health check, US and worldwide

Date:


The reliability of services delivered by ISPs, cloud providers and conferencing services (a.k.a. unified communications-as-a-service (UCaaS)) is an indication of how well served businesses are via the internet.

ThousandEyes is monitoring how these providers are handling the performance challenges they face. It will provide Network World a roundup of interesting events of the week in the delivery of these services, and Network World will provide a summary here. Stop back next week for another update, and see more details here.

Updated Dec. 12

Global outages across all three categories last week increased from 282 to 347, up 23%. In the US, they increased from 78 to 90, up 15%.

Globally, ISP outages increased from 210 to 281, up 34%, and in the US they increased from 61 to 76, up 25%. 

Globally, cloud-provider network outages dropped from eight to four, and in the US remained the same at two.

Globally, collaboration-app network outages jumped from one to seven, and in the US dropped from one to zero.

Two notable outages:

About 2:30 p.m. EST on December 5, AWS’s Ohio-based us-east-2 region experienced a connectivity issue that appeared to affect some customer internet connectivity to and from the region, characterized by significant packet loss between it and global locations. The loss was seen only between end-users connecting via ISPs and didn’t appear to affect connectivity between instances within the region or between regions. The packet loss continued for more than an hour before resolving around 3:50 p.m. EST. Click here for an interactive view.

On December 7, NTT America experienced an outage affecting customers and downstream partners across the US, the Netherlands, Belgium, the Republic of Korea, and Japan. The 13-minute outage was first observed around 12:15 a.m. EST and appeared to center on NTT nodes in Newark, New Jersey, and Ashburn, Virginia. Ten minutes after being observed, the Ashburn nodes appeared to clear. The outage was cleared around 12:30 a.m. EST. Click here for an interactive view.

Updated Dec. 5

Global outages across all three categories last week increased from 222 to 282, up 27%. In the US, outages increased from 48 to 78, up 63%.

Global ISP outages increased from 173 to 210, up 21%, and in the US increased from 32 to 61, up 90%. 

Global cloud-provider network outages jumped from four to eight, while in the US they remained at two.

Global collaboration-app network outages dropped from six to one, and in the U.S., from five to one.

Two notable outages:

On November 29, TATA Communications (America) Inc., experienced an outage affecting many of its downstream partners and customers including in the US, Canada, the UK, France, the Netherlands, Chile, Peru, Colombia, Saudi Arabia, Argentina, India, Germany, Hong Kong, and Singapore. The 33-minute outage was first observed around 9:20 a.m. EST, and apparently centered on TATA nodes in Newark, New Jersey. Ten minutes later the outage appeared to include nodes in New York, New York; London, England; Marseille, France; and Pune and Bangalore, India. This appeared to coincide with the peak in the number of regions, downstream partners, and customers affected. Around five minutes after the peak, just nodes in Newark, London, and Marseille exhibited outage conditions. The outage was cleared around 9:55 a.m. EST. Click here for an interactive view.

On December 1, Microsoft experienced an issue affecting user access to some Microsoft services, including Office 365, predominantly in the APJC region. First observed around 7:50 p.m. EST and lasting approximately an hour and 18 minutes, the outage appeared to initiate in Microsoft’s Japan infrastructure before affecting other Microsoft servers in the region. Network connectivity to the service did not appear to experience any significant issues throughout the outage. The outage was cleared around 9:10 p.m. EST. Click here for an interactive view.

Updated Nov. 28

Global outages across all three categories last week decreased from 331 to 222, down 33% compared to the week prior. In the US, they dropped from 121 to 48, down 60%.

Globally, ISP outages decreased from 246 to 173, down 30%. In the US they dropped from 85 to 32, down 62%. 

Globally, cloud-provider network outages decreased from five to four and in the US from three to two.

Globally, collaboration-app network outages decreased from nine to six outages, while in the US they decreased from six to five.

Two outages of note:

On November 23, Astute Hosting experienced an outage affecting multiple downstream providers and customers in the US, Australia, Singapore, Canada, and the UK. The 19-minute outage was first observed around 4:40 a.m. EST and appeared to center on Astute Holding nodes in Seattle, Washington. Fifteen minutes later, some of the nodes appeared to recover. The outage was cleared around 5:00 a.m. EST. Click here for an interactive view.

On November 21, Embratel experienced a series of outages over a period of an hour and 35 minutes that affected downstream providers and customers in the US and Canada. The 10-minute outage was first observed around 10:30 p.m. EST centered on Embratel nodes in Atlanta, Georgia. An hour and 30 minutes later, nodes located in Sao Paulo, Brazil, also exhibited outage conditions. The outage was cleared around 12:05 a.m. EST. Click here for an interactive view.

Updated Nov. 21

Global outages across all three categories last week decreased from 352 to 331, down 6% from the week prior. In the US, they decreased from 124 to 121, down 2%.

Globally ISP outages decreased, from 265 to 246, down 7%, and in the US, they dropped from 93 to 85, down 9%. 

Globally, cloud provider outages dropped from 14 to five, while in the US they dropped from six to three.

Globally, collaboration-app network outages remained the at nine and increased in the US from five to six.

Two notable outages:

On November 17, GTT Communications, experienced an outage affecting some of its partners and customers in the US, Australia, Canada, China, Brazil, Republic of Korea, New Zealand, the Netherlands, Singapore, Hong Kong, the Philippines, and Japan. The hour-and-28-minute outage was first observed around 6:10 a.m. EST and appeared to center on GTT nodes in San Jose, California. Twenty minutes later, nodes in San Francisco, California, also exhibited outage conditions. Twenty-five minutes after that, nodes in Seattle, Washington, exhibited outages, too. The outages were cleared around 7:40 a.m. EST. Click here for an interactive view.

On November 16, Cogent Communications experienced a 44-minute outage affecting multiple downstream providers and customers across the US and the UK. The outage was first observed around 12:50 a.m. EST and appeared to center on Cogent nodes in New York, New York. Fifteen minutes later some of the nodes appeared to recover, reducing the impact. The outage was cleared around 1:35 a.m. EST. Click here for an interactive view.

Updated Nov. 7

Global outages across all three categories last week decreased from 381 to 361, down 5% compared to the week prior. In the US, they dropped from 130 to 74, down 43%.

Globally, ISP outages decreased from 298 to 289, down 3%, and dropped from 107 to 64 in the US, a 40% decrease. 

Globally, cloud-provider outages remained the same at nine. In the US they dropped from four to two.

Globally, collaboration-app network outages decreased from five to two, and in the US dropped from five to one.

Two notable outages:

On November 2, TATA Communications (America) experienced an outage affecting downstream partners and customers in countries including the US, the UK, the Netherlands, Australia, Vietnam, Germany, Poland, France, China, India, and Singapore. The 24 minute outage was first observed around 8:40 a.m. EDT, and initially centered on TATA nodes in London, England. Fifteen minutes later, nodes in Newark, New Jersey, San Francisco, California, and the United Arab Emirates (UAE) also exhibited outage conditions. The outage was cleared around 9:05 a.m. EDT. Click here for an interactive view.

On November 2, AT&T experienced an outage affecting AT&T customers and partners across the US. The nine-minute outage was first observed around 7:15 p.m. EDT, appearing to center on AT&T nodes in San Jose, California. Five minutes later the number of San Jose nodes exhibiting outage conditions appeared to rise. The outage was cleared at around 7:25 p.m. EDT. Click here for an interactive view.

Updated Oct. 31

Global outages across all three categories last week increased from 374 to 381, up 2% compared to the week prior. In the US, outages increased from 94 to 130, up 38%.

Globally, ISP outages increased from 293 to 298, up 2%, while in the US they increased from 72 to 107, up 49%.

Globally, cloud-provider network outages decreased from 10 to nine, and in the US they remained the same at four.

Globally collaboration-app network outages decreased from seven to five, and in the US they increased from four to five.

Three notable outages:

On October 25, Zscaler experienced an outage that impacted customers using Zscaler Internet Access (ZIA) services on the Zscaler Cloud network 2. First observed around 7:46 a.m. EDT, the outage appeared to affect customers’ network connectivity. Around 7:46 a.m. EDT, Zscaler announced it had identified the cause of the issue and begun mitigation. It appeared the majority of customer connectivity had been restored by 11:34 a.m. EDT, with Zscaler announcing the issue resolved around 4:22 p.m. EDT. See here for a more detailed analysis of the outage.

Around 1:30 a.m. EDT on October 27, Salesforce experienced an outage that affected customers globally that appeared to last about an hour and 24 minutes. It manifested itself as a series of server errors and timeouts, which is consistent with a backend service issue. Around 2:14 a.m. EDT, Salesforce announced it was taking steps to alleviate the issue. Around 2:35 a.m. EDT, services appeared to start to return with the major portion of the issue clearing around 3:15 a.m. EDT. Around 7:23 a.m. EDT, the outage was officially cleared. Click here for an interactive view.

On October 28, Facebook experienced a service disruption that rendered the application inaccessible to some users globally. First observed around 3:33 p.m. EDT, the disruption appeared to prevent some users from accessing content and manifested as a combination of HTTP server errors and packet loss at Facebook’s network edge. The incident appeared to clear around 4:45 p.m.EDT. Click here for an interactive view.

Updated Oct. 24

Global outages across all three categories last week increased from 283 to 374, up 32% compared to the week prior. In the US, they increased from 72 to 94, up 31%.

Globally, ISP outages jumped from 194 to 293, up 51% while in the US they increased from 55 to 72, up 31%.

Globally cloud-provider network outages jumped from six to 10, and in the US increased from one to four.

Globally collaboration-app network outages decreased from nine to seven, and in the US decreased from six to four.

Two notable outages:

On October 19, LinkedIn experienced a service disruption affecting its mobile and desktop user base. The disruption was first observed around 6:34 p.m. EDT, with users attempting to post to LinkedIn receiving error messages. The total disruption lasted around an hour and a half during which no network issues were observed connecting to LinkedIn web servers indicating the issue was application related. The service was restored around 7 p.m. EDT.

On October 22, Level 3 Communications experienced an outage affecting downstream partners and customers in the US, Canada, the Netherlands, and Spain. The outage lasted a total of 18 minutes divided into two occurrences distributed over a 30-minute period. The first occurrence was observed around 12:35 a.m. EDT and appeared centered on Level 3 nodes in Chicago, Ilinois. Five minutes later, nodes in St. Louis, Missouri, also exhibited outage conditions. Ten minutes after the outage appearing to clear, the St. Louis nodes began exhibiting outage conditions again. The outage was cleared around 1:05 a.m. EDT. Click here for an interactive view.

Updated Oct. 17

Global outages across all three categories last week decreased from 328 to 283, a 14% decrease compared to the week prior. In the US, outages dropped from 101 to 72, down 29%.

Global ISP outages decreased from 239 to 194, down19%, and in the US decrease from 76 to 55, down 28%. 

Global cloud-provider network outages dropped from 12 to six, while in the US they dropped from six to one.

Global collaboration-app network outages decreased from 10 to nine, and from seven to six in the US.

Two notable outages:

On October 10, Microsoft experienced an outage affecting downstream partners and access to services running on Microsoft environments. The outage, which lasted 19 minutes, was first observed around 3:50 p.m. EDT and appeared centered on Microsoft nodes in Des Moines, Iowa. Ten minutes after that, nodes in Los Angeles, California exhibited outage conditions and appeared to clear five minutes later. The Des Moines outage was cleared around 4:10 p.m. EDT. Click here for an interactive view.



Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Share post:

Popular

More like this
Related