Mailing List Archive: AS37468 (Angola Cables)

AS37468 (Angola Cables) - Route Leak?

May 25, 2023, 4:56 AM

Post #1 of 5 (187 views)

Hey Folks,

Seeing massive packet loss on routes from AWS to Hetzner today. First was AWS USW2 -> Hetzner (e.g. 88.99.88.69).

Traffic was transiting via AS37468 (Angola Cables) in Coresite IX.

Now got loss from AWS apse1/apse2. Traffic transiting via AS37468 on Equinix IX.

I e-mailed Hetzner NOC but they don’t seem entirely bothered, currently.

My traceroute [v0.94]
jcasc-rtc01 (10.36.21.252) -> phil.lavin.me.uk 2023-05-25T11:50:13+0000
Keys: Help Display mode Restart statistics Order of fields quit
Packets Pings
Host Loss% Snt Last Avg Best Wrst StDev
1. ip-10-36-17-199.ap-southeast- 0.0% 18 0.1 0.6 0.1 7.7 1.8
2. ec2-18-141-171-15.ap-southeas 0.0% 18 4.3 17.5 0.9 95.7 24.0
ec2-18-141-171-1.ap-southeast-1.compute.amazonaws.com
3. (waiting for reply)
4. (waiting for reply)
5. (waiting for reply)
6. (waiting for reply)
7. (waiting for reply)
8. 100.65.10.161 0.0% 17 0.6 1.4 0.3 9.6 2.4
100.65.11.65
9. 150.222.108.75 0.0% 17 2.1 3.0 1.0 13.1 3.3
52.93.10.74
10. 150.222.108.82 0.0% 17 2.2 2.4 1.3 10.2 2.1
11. 52.93.11.115 0.0% 17 5.8 2.4 1.2 9.7 2.5
52.93.10.185
12. 37468-sg1-ix.equinix.com 68.8% 17 268.6 279.0 262.4 312.8 19.8
13. 102.219.127.3 93.8% 17 420.0 420.0 420.0 420.0 0.0
14. (waiting for reply)
15. 195.66.227.209 62.5% 17 467.9 456.9 440.3 488.2 18.5
16. core6.par.hetzner.com 75.0% 17 455.6 464.1 455.6 486.3 14.8
17. core11.nbg1.hetzner.com 75.0% 17 459.5 467.5 445.9 497.3 21.8
18. core23.fsn1.hetzner.com 68.8% 17 478.4 441.0 390.0 478.4 32.0
19. ex9k1.dc1.fsn1.hetzner.com 87.5% 17 460.4 454.2 448.1 460.4 8.7
20. vmh02.lavin.me.uk 75.0% 17 433.3 424.2 382.7 441.9 27.9
21. (waiting for reply)
22. http-lb-01.lavin.me.uk 75.0% 17 436.8 438.6 385.0 493.3 44.2

I’ve been out of the BGP game for a few years now. Anybody have visibility of the extent of the leaks?

Phil

Re: AS37468 (Angola Cables) - Route Leak? [ In reply to ]

outages at outages

May 25, 2023, 5:00 AM

Post #2 of 5 (187 views)

Permalink

I've also emailed Hetzner, and they told me they do not see any issues and
said it's Amazon's fault.

Does anyone have some contacts at Hetzner?

Regards,

Michael

Re: AS37468 (Angola Cables) - Route Leak? [ In reply to ]

outages at outages

May 25, 2023, 5:26 AM

Post #3 of 5 (187 views)

Permalink

On 5/25/23 14:00, Michael B. Williams via Outages wrote:

> I've also emailed Hetzner, and they told me they do not see any issues
> and said it's Amazon's fault.

I've reached out to some known folk at Angola Cables. Will let you know
if I hear back.

Mark.

Re: AS37468 (Angola Cables) - Route Leak? [ In reply to ]

outages at outages

May 25, 2023, 5:27 AM

Post #4 of 5 (187 views)

Permalink

Hey, thanks for flagging. We (AWS) are taking a look for options to mitigate, loss seems to be on a third party.

On 25 May 2023, at 13:00, Michael B. Williams via Outages <outages@outages.org> wrote:

I've also emailed Hetzner, and they told me they do not see any issues and said it's Amazon's fault.

Does anyone have some contacts at Hetzner?

Regards,

Michael

_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: AS37468 (Angola Cables) - Route Leak? [ In reply to ]

outages at outages

May 25, 2023, 5:35 AM

Post #5 of 5 (187 views)

Permalink

Return path is via NTT and looks OK:

My traceroute [v0.94]
http-lb-01 (88.99.88.69) -> 216.147.4.201 2023-05-25T12:34:28+0000
Keys: Help Display mode Restart statistics Order of fields quit
Packets Pings
Host Loss% Snt Last Avg Best Wrst StDev
1. fe-fw-01.lavin.me.uk 0.0% 19 0.2 0.1 0.1 0.2 0.0
2. 10.69.69.1 0.0% 18 0.3 0.2 0.2 0.3 0.0
3. static.225.8.4.46.clients.your-server.de 0.0% 18 0.5 0.8 0.4 5.3 1.1
4. core23.fsn1.hetzner.com 0.0% 18 0.7 1.7 0.5 9.7 2.6
5. core0.fra.hetzner.com 0.0% 18 5.2 5.1 5.1 5.2 0.0
6. 213.198.82.129 0.0% 18 8.2 5.8 5.5 8.2 0.6
7. ae-3.r20.frnkge13.de.bb.gin.ntt.net 0.0% 18 5.5 8.5 5.2 48.7 10.1
8. ae-4.r20.vienat02.at.bb.gin.ntt.net 0.0% 18 22.0 18.1 16.6 22.0 1.7
9. ae-0.r21.vienat02.at.bb.gin.ntt.net 0.0% 18 26.8 21.8 17.1 29.9 3.4
10. ae-10.r23.sngpsi07.sg.bb.gin.ntt.net 94.1% 18 162.1 162.1 162.1 162.1 0.0
11. ae-1.r00.sngpsi07.sg.bb.gin.ntt.net 0.0% 18 156.9 157.1 156.9 157.2 0.1
12. ae-0.amazon.sngpsi07.sg.bb.gin.ntt.net 0.0% 18 158.7 159.6 158.3 164.3 2.0
13. (waiting for reply)
14. (waiting for reply)
15. (waiting for reply)
16. (waiting for reply)
17. (waiting for reply)
18. (waiting for reply)
19. (waiting for reply)
20. (waiting for reply)
21. (waiting for reply)
22. (waiting for reply)
23. 216.147.4.201 70.6% 18 508.8 515.5 504.3 523.0 8.4

_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Mailing List Archive

Mailing List Archive

Attached Files: