First I love this list, but come on y'all. I've gotten like 50 or 60 notifications about this today. Please take it over to the discussions thread.
For the rest of the unsubstantiated. As of 2100UTC Facebook has started resuming communications.
Here are some major relevant posts for everything known so far.
https://blog.cloudflare.com/october-2021-facebook-outage/
https://engineering.fb.com/2021/10/04/networking-traffic/outage/
[https://engineering.fb.com/wp-content/uploads/2021/10/logo.jpg]<https://engineering.fb.com/2021/10/04/networking-traffic/outage/>
Update about the October 4th outage - Facebook Engineering<https://engineering.fb.com/2021/10/04/networking-traffic/outage/>
To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies.
engineering.fb.com
[https://blog.cloudflare.com/content/images/2021/10/Understanding-how-Facebook-disappeared-from-the-Internet-og--1--1.png]<https://blog.cloudflare.com/october-2021-facebook-outage/>
Understanding How Facebook Disappeared from the Internet<https://blog.cloudflare.com/october-2021-facebook-outage/>
Today at 1651 UTC, we opened an internal incident entitled "Facebook DNS lookup returning SERVFAIL" because we were worried that something was wrong with our DNS resolver 1.1.1.1. But as we were about to post on our public status page we realized something else more serious was going on.
blog.cloudflare.com
Thank You,
Aaron
________________________________
From: Outages <outages-bounces@outages.org> on behalf of Jürgen Botz via Outages <outages@outages.org>
Sent: Monday, October 4, 2021 2:21 PM
To: outages@outages.org <outages@outages.org>
Subject: Re: [outages] Facebook Down
[EXTERNAL]
It's worth noting that all these emails to the list are arriving on my
(independent) mail server late and out of order. Unlikely to be
coincidence.
Somebody on Twitter said that the CEO of Cloudflare said that all of
Facebook's BGP routes "had been withdrawn", but that Tweet wasn't
from any particularly reliable source. Still the problem does seem
go further than just DNS for Facebook properties.
-j
On 10/4/21 13:10, Arthur Lockman via Outages wrote:
> Facebook, Instagram, and WhatsApp all appear to be down.
>
> ? nslookup facebook.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffacebook.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BgSzY%2B94cgTKFQrbFdIBYsPDhly3rr%2FQH8oy%2BbmPmvc%3D&reserved=0>
> ;; Got SERVFAIL reply from 1.1.1.1, trying next server
> Server:1.0.0.1
> Address:1.0.0.1#53
>
> ** server can't find facebook.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffacebook.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BgSzY%2B94cgTKFQrbFdIBYsPDhly3rr%2FQH8oy%2BbmPmvc%3D&reserved=0>: SERVFAIL
>
> ? nslookup whatsapp.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwhatsapp.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=iAW1va8dUNezxT0Xzo2%2F0elcFHk6fZIQPgj5jxVE%2Blg%3D&reserved=0>
> ;; Got SERVFAIL reply from 1.0.0.1, trying next server
> Server:1.1.1.1
> Address:1.1.1.1#53
>
> ** server can't find whatsapp.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwhatsapp.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=iAW1va8dUNezxT0Xzo2%2F0elcFHk6fZIQPgj5jxVE%2Blg%3D&reserved=0>: SERVFAIL
>
> Seems like it’s DNS once again.
>
> *- Arthur Lockman (he/him)*
>
>> On Oct 4, 2021, at 11:46 AM, Matt Hoppes via Outages
>> <outages@outages.org <mailto:outages@outages.org>> wrote:
>>
>> Is anyone else seeing Facebook down? Seems to be offline here in
>> Pennsylvania.. started with error messages now DNS errors.
>>
>> Seeing lots of errors on Instagram, QuickBooks, Whatsapp, Amazon.
>> _______________________________________________
>> Outages mailing list
>> Outages@outages.org <mailto:Outages@outages.org>
>> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sHxMTVGPEVvYE7f2Nh0OHZYNOYRB3a8%2BPTZnkHb%2FuKE%3D&reserved=0
>
>
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sHxMTVGPEVvYE7f2Nh0OHZYNOYRB3a8%2BPTZnkHb%2FuKE%3D&reserved=0
>
_______________________________________________
Outages mailing list
Outages@outages.org
https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sHxMTVGPEVvYE7f2Nh0OHZYNOYRB3a8%2BPTZnkHb%2FuKE%3D&reserved=0
-****NOTICE OF CONFIDENTIALITY****: This electronic transmission and any documents or other writings accompanying it are intended only for the use of the recipient(s) named above. This transmission may include confidential information that is protected by state and federal law. If you have received this communication in error, please reply to the sender at the sender's e-mail address and indicate that you have received a message in error. Then delete it. Any disclosure, copying, distribution or the taking of any action concerning the contents of this communication or any attachments by anyone other than the named recipient(s) is strictly prohibited.
For the rest of the unsubstantiated. As of 2100UTC Facebook has started resuming communications.
Here are some major relevant posts for everything known so far.
https://blog.cloudflare.com/october-2021-facebook-outage/
https://engineering.fb.com/2021/10/04/networking-traffic/outage/
[https://engineering.fb.com/wp-content/uploads/2021/10/logo.jpg]<https://engineering.fb.com/2021/10/04/networking-traffic/outage/>
Update about the October 4th outage - Facebook Engineering<https://engineering.fb.com/2021/10/04/networking-traffic/outage/>
To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies.
engineering.fb.com
[https://blog.cloudflare.com/content/images/2021/10/Understanding-how-Facebook-disappeared-from-the-Internet-og--1--1.png]<https://blog.cloudflare.com/october-2021-facebook-outage/>
Understanding How Facebook Disappeared from the Internet<https://blog.cloudflare.com/october-2021-facebook-outage/>
Today at 1651 UTC, we opened an internal incident entitled "Facebook DNS lookup returning SERVFAIL" because we were worried that something was wrong with our DNS resolver 1.1.1.1. But as we were about to post on our public status page we realized something else more serious was going on.
blog.cloudflare.com
Thank You,
Aaron
________________________________
From: Outages <outages-bounces@outages.org> on behalf of Jürgen Botz via Outages <outages@outages.org>
Sent: Monday, October 4, 2021 2:21 PM
To: outages@outages.org <outages@outages.org>
Subject: Re: [outages] Facebook Down
[EXTERNAL]
It's worth noting that all these emails to the list are arriving on my
(independent) mail server late and out of order. Unlikely to be
coincidence.
Somebody on Twitter said that the CEO of Cloudflare said that all of
Facebook's BGP routes "had been withdrawn", but that Tweet wasn't
from any particularly reliable source. Still the problem does seem
go further than just DNS for Facebook properties.
-j
On 10/4/21 13:10, Arthur Lockman via Outages wrote:
> Facebook, Instagram, and WhatsApp all appear to be down.
>
> ? nslookup facebook.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffacebook.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BgSzY%2B94cgTKFQrbFdIBYsPDhly3rr%2FQH8oy%2BbmPmvc%3D&reserved=0>
> ;; Got SERVFAIL reply from 1.1.1.1, trying next server
> Server:1.0.0.1
> Address:1.0.0.1#53
>
> ** server can't find facebook.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffacebook.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BgSzY%2B94cgTKFQrbFdIBYsPDhly3rr%2FQH8oy%2BbmPmvc%3D&reserved=0>: SERVFAIL
>
> ? nslookup whatsapp.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwhatsapp.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=iAW1va8dUNezxT0Xzo2%2F0elcFHk6fZIQPgj5jxVE%2Blg%3D&reserved=0>
> ;; Got SERVFAIL reply from 1.0.0.1, trying next server
> Server:1.1.1.1
> Address:1.1.1.1#53
>
> ** server can't find whatsapp.com <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwhatsapp.com%2F&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=iAW1va8dUNezxT0Xzo2%2F0elcFHk6fZIQPgj5jxVE%2Blg%3D&reserved=0>: SERVFAIL
>
> Seems like it’s DNS once again.
>
> *- Arthur Lockman (he/him)*
>
>> On Oct 4, 2021, at 11:46 AM, Matt Hoppes via Outages
>> <outages@outages.org <mailto:outages@outages.org>> wrote:
>>
>> Is anyone else seeing Facebook down? Seems to be offline here in
>> Pennsylvania.. started with error messages now DNS errors.
>>
>> Seeing lots of errors on Instagram, QuickBooks, Whatsapp, Amazon.
>> _______________________________________________
>> Outages mailing list
>> Outages@outages.org <mailto:Outages@outages.org>
>> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sHxMTVGPEVvYE7f2Nh0OHZYNOYRB3a8%2BPTZnkHb%2FuKE%3D&reserved=0
>
>
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sHxMTVGPEVvYE7f2Nh0OHZYNOYRB3a8%2BPTZnkHb%2FuKE%3D&reserved=0
>
_______________________________________________
Outages mailing list
Outages@outages.org
https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=04%7C01%7CAaron%40Computersnstuffwaco.com%7Cf5792d985e17418ffff408d987c0475f%7C8d5cda5fa70343d1b5eeb772587b996d%7C0%7C0%7C637690082179321807%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sHxMTVGPEVvYE7f2Nh0OHZYNOYRB3a8%2BPTZnkHb%2FuKE%3D&reserved=0
-****NOTICE OF CONFIDENTIALITY****: This electronic transmission and any documents or other writings accompanying it are intended only for the use of the recipient(s) named above. This transmission may include confidential information that is protected by state and federal law. If you have received this communication in error, please reply to the sender at the sender's e-mail address and indicate that you have received a message in error. Then delete it. Any disclosure, copying, distribution or the taking of any action concerning the contents of this communication or any attachments by anyone other than the named recipient(s) is strictly prohibited.