Post 9yeH41BdRyRdoimi8W by href@pleroma.fr
 (DIR) More posts by href@pleroma.fr
 (DIR) Post #9yeEHla9xqC1c27Ubg by thor@mstdn.social
       2020-08-30T12:26:04Z
       
       1 likes, 1 repeats
       
       kind of confused over what’s happening with the internet over here. i thought rebooting the broadband routers supplied by the ISP (configured in bridge mode) had resolved the internet connectivity issues, but it seems it’s just going up and down randomly. i suspect it’s the isp that has trouble... or, for all i know, some dude is up a pole down the street, rewiring things. it was doing this earlier too, right before it went down completely.
       
 (DIR) Post #9yeEIOLHr4T9pCSfL6 by quad@weeaboo.space
       2020-08-30T12:27:01.787810Z
       
       0 likes, 0 repeats
       
       @thor You having internet issues? I had from about 12:15 until 30 minutes ago when I found out switching from OpenDNS fixed it.
       
 (DIR) Post #9yeEPOdj9D5wm4QWKu by quad@weeaboo.space
       2020-08-30T12:28:02.948097Z
       
       0 likes, 0 repeats
       
       @thor Not sure if it really was OpenDNS' fault, but both my Pi-holes started failing at once which was a huge hint. Turns out that switching them from OpenDNS to any other DNS provider fixed my internet
       
 (DIR) Post #9yeEl8OmDE5sm3ncBM by thor@mstdn.social
       2020-08-30T12:29:13Z
       
       0 likes, 0 repeats
       
       @quad hm, i’m using google’s dns but i can’t even ping anything so
       
 (DIR) Post #9yeEl9GeytCBTB0eAa by quad@weeaboo.space
       2020-08-30T12:30:22.617120Z
       
       0 likes, 0 repeats
       
       @thor Alright, in that case you probably have a different issue. I could ping IPs fine.
       
 (DIR) Post #9yeEwww4enfchJ0Xi4 by thor@mstdn.social
       2020-08-30T12:30:32Z
       
       0 likes, 0 repeats
       
       @quad am using google dns, and noticed that, since i have a ping running against that address, it basically stops responding when the internet goes down, so it’s a true connectivity issue, not just dns
       
 (DIR) Post #9yeEwxPUtPCqAYm2ZU by thor@mstdn.social
       2020-08-30T12:32:09Z
       
       0 likes, 0 repeats
       
       @quad it goes up and down and as you can see from the sequence numbers, it goes down for a long time before coming up again
       
 (DIR) Post #9yeEwxywlbYvwVMLpI by quad@weeaboo.space
       2020-08-30T12:33:13.259444Z
       
       0 likes, 0 repeats
       
       @thor Yeah you don't have the same issue as me, I was just curious if OpenDNS was having issues in Norway if others had the same issue as me.Also those ping times, even DSL tends to be better than that, is your connection always that bad?
       
 (DIR) Post #9yeF7w8004qbNUpBLM by thor@mstdn.social
       2020-08-30T12:33:49Z
       
       0 likes, 0 repeats
       
       @quad lysenett might be having trouble but i can’t load their damned service status page on a smartphone...
       
 (DIR) Post #9yeF7wkdgPkvJKu2ZU by quad@weeaboo.space
       2020-08-30T12:34:58.055468Z
       
       0 likes, 0 repeats
       
       @thor In that case it does seem likely that it's your ISP.
       
 (DIR) Post #9yeFPl7re2JMT4GB2u by thor@mstdn.social
       2020-08-30T12:35:57Z
       
       0 likes, 0 repeats
       
       @quad or maybe they are having so much trouble not even their service status page is broken... just got this error message...
       
 (DIR) Post #9yeFPlLKpx5R8qYw2i by quad@weeaboo.space
       2020-08-30T12:37:33.535866Z
       
       0 likes, 0 repeats
       
       @thor I can barely load half their site from here (Florø) so something is definitely up
       
 (DIR) Post #9yeFhMazaOrdbLHLPs by thor@mstdn.social
       2020-08-30T12:36:41Z
       
       0 likes, 0 repeats
       
       @quad no, not to norway anyway. i don’t remember what i usually get abroad, but in norway it’s often <1ms to NIX router at UIO.
       
 (DIR) Post #9yeFhMwGJJsUfJEKZM by quad@weeaboo.space
       2020-08-30T12:41:02.830905Z
       
       0 likes, 0 repeats
       
       @thor I thought 8.8.8.8 was pretty much plugged into NIX?I always get near identical ping times to nix.no and 8.8.8.8 at least. But I don't know any test ip to NIX besides their website, their route servers don't seem to respond to pings at all.Currently I have 19.5ms to nix.no and 20.5ms to 8.8.8.8
       
 (DIR) Post #9yeFlHoBKKnhucJoDA by thor@mstdn.social
       2020-08-30T12:41:14Z
       
       0 likes, 0 repeats
       
       @quad usually it’s just the customers who can’t access the internet, and the website works fine
       
 (DIR) Post #9yeFlISau57vvxE5Ca by quad@weeaboo.space
       2020-08-30T12:42:27.128228Z
       
       0 likes, 0 repeats
       
       @thor when stuff like this happens it usually means there was a routing fuckup somewhere in their network, not that equipment failed.Who knows, maybe a bunch of their shit somehow failed if they're having openDNS issues like me.Doubt it though, and ISPs internal operations hopefully don't rely on openDNS
       
 (DIR) Post #9yeGHbNC7ZxHrF6YN6 by thor@mstdn.social
       2020-08-30T12:45:38Z
       
       0 likes, 0 repeats
       
       @quad is the address 8.8.8.8 routed differently depending on the country? i mean i guess it makes sense. but yeah, ping times to nix are usually very low. i haven’t tested them right now. more concerned with internet access itself than ping times. when the internet came up again earlier, vg.no loaded instantly.
       
 (DIR) Post #9yeGHc6ZOsFe7yKn68 by quad@weeaboo.space
       2020-08-30T12:46:45.056425Z
       
       0 likes, 0 repeats
       
       @thor Well yes, 8.8.8.8 uses anycast. There's servers all around the world and you hit the one closest to you.Since I've always had about identical ping times to both nix.no and 8.8.8.8 I always just assumed there was an 8.8.8.8 server pretty close to NIX
       
 (DIR) Post #9yeGesH3RxRuw4KWdk by quad@weeaboo.space
       2020-08-30T12:48:49.047318Z
       
       0 likes, 0 repeats
       
       @thor P.S just noticed cloudflare is reporting issues with a transit provider: https://www.cloudflarestatus.com/Around 10:20 UTC. Which is 12:20 in Norway. Coincidentally 5 minutes after I started having issues.There's probably one big ISP somewhere fucking up everything and might be why Lyse are having issues too. And why my OpenDNS stopped working
       
 (DIR) Post #9yeGsp8RutX9FrxMoq by thor@mstdn.social
       2020-08-30T12:48:14Z
       
       0 likes, 0 repeats
       
       @quad it’s in cases like these that a map if isps and main exchanges and their connection statuses would be handy to have.
       
 (DIR) Post #9yeGspUmZrOkN8PCd6 by quad@weeaboo.space
       2020-08-30T12:51:41.812432Z
       
       1 likes, 0 repeats
       
       @thor There was some internet map that i used maybe like 5-6 years ago but I think it's gone. Wonder if there's any alternative
       
 (DIR) Post #9yeH41BdRyRdoimi8W by href@pleroma.fr
       2020-08-30T12:42:36.014394Z
       
       1 likes, 2 repeats
       
       @quad @thor Level3 (a Tier-1 ISP) is down/half-down/doing shit since a couple of hours, it's probably the reason
       
 (DIR) Post #9yeHRg9DKBApW1vzX6 by thor@mstdn.social
       2020-08-30T12:55:43Z
       
       0 likes, 0 repeats
       
       @quad there is this specific router i like to ping at nix that appears in traceroutes against ifi.uio.no. it has an important sounding name. could you find the ip for me?
       
 (DIR) Post #9yeHRgbDe3Ziut2MBU by quad@weeaboo.space
       2020-08-30T12:58:45.681132Z
       
       0 likes, 0 repeats
       
       @thor It doesn't seem like I can see it. Appears that my ISP goes to uninett via BKK rather than NIX.Unless the "???" is NIX, but it doesn't respond to pings anyways.
       
 (DIR) Post #9yeHtpGf0eyjuRq4uG by thor@mstdn.social
       2020-08-30T12:46:59Z
       
       0 likes, 0 repeats
       
       @href @quad hm, i didn’t run a ping against a domestic server yet. where does Level3 operate?
       
 (DIR) Post #9yeHtpWG4fSIgp8XDc by href@pleroma.fr
       2020-08-30T12:47:39.878722Z
       
       1 likes, 0 repeats
       
       @thor @quad Everywhere-- it's a Tier-1. Most networks use it, directly or indirectly. Also since it's being down, lesser-used links are now used, which tends to saturate, etc.
       
 (DIR) Post #9yeHtqGLJKJozkhL3A by thor@mstdn.social
       2020-08-30T12:49:05Z
       
       0 likes, 0 repeats
       
       @href @quad hm, well, right. i should ping NIX but i need the IP to their main router.
       
 (DIR) Post #9yeHtqhzeWR8NVdQ9I by href@pleroma.fr
       2020-08-30T12:49:34.946857Z
       
       0 likes, 0 repeats
       
       @thor @quad try a traceroute, usually better than ping to see networking issues
       
 (DIR) Post #9yeHtr8E4zQ7gruN2O by thor@mstdn.social
       2020-08-30T12:51:30Z
       
       0 likes, 0 repeats
       
       @href @quad yeah, i did it from the router earlier but it didn’t like the lack of DNS. doing it for laptop now, it’s giving me hops
       
 (DIR) Post #9yeHtriNuYLNV0pFOi by thor@mstdn.social
       2020-08-30T12:54:13Z
       
       0 likes, 0 repeats
       
       @href @quad so the network goes up and down a bit, so the trace succeeds part of the time. doesn’t look like 8.8.8.8 is very close to me in terms of hops really...
       
 (DIR) Post #9yeHts2EikDuUa76LA by href@pleroma.fr
       2020-08-30T12:56:41.202695Z
       
       0 likes, 0 repeats
       
       @thor @quad seems to go thru Telia, another Tier-1 ; but they too have issues (due to Level3). Probably a saturated link there (from Telia to Google)
       
 (DIR) Post #9yeHtsN9SyxBXRtnwO by thor@mstdn.social
       2020-08-30T12:58:58Z
       
       0 likes, 0 repeats
       
       @href @quad doesn’t seem to match up with what quad is saying about google dns and anycast, and 8.8.8.8 being routed to nix (norwegian internet exchange) in norway. every isp usually has a direct connection there but maybe lyse goes via another isp..
       
 (DIR) Post #9yeHtteCj4BjUcsw9w by quad@weeaboo.space
       2020-08-30T13:01:01.135646Z
       
       1 likes, 0 repeats
       
       @thor @href Level3 probably won't affect 8.8.8.8 at nix.But it's very plausaible that Level3 goes down, something at your ISP goes "Oh no!" because it doesn't handle it and crashes, then you lose internet.Although to my knowledge level3 doesn't operate much in Norway (if at all outside of NIX?) so it shouldn't have much of a direct effect on us. But the internet is more fragile than you think. A single Trier 1 ISP fucks up and the dominio effect will kill far more of the internet than it should
       
 (DIR) Post #9yeIuC1SVXWSR7T2aO by thor@mstdn.social
       2020-08-30T13:11:45Z
       
       0 likes, 0 repeats
       
       @quad @href my landlord asked the isp and got this answer
       
 (DIR) Post #9yeIuCpRVhVMw8qxUm by thor@mstdn.social
       2020-08-30T13:12:13Z
       
       0 likes, 0 repeats
       
       @quad @href english: “it looks like something is wrong with the internet all over europe” etc
       
 (DIR) Post #9yeIuDlE2rj3pLt6Yq by quad@weeaboo.space
       2020-08-30T13:13:15.750303Z
       
       0 likes, 0 repeats
       
       @thor @href which means yeah, level3's outage is probably what they're dealing with
       
 (DIR) Post #9yeJF9kOA8IzSdTlSq by GNUxeava@fedi.absturztau.be
       2020-08-30T13:22:39.129033Z
       
       0 likes, 0 repeats
       
       @thor clouflare shat itself
       
 (DIR) Post #9yeJtTepYVJcnM6ct6 by thor@mstdn.social
       2020-08-30T13:27:01Z
       
       2 likes, 0 repeats
       
       @GNUxeava not only cloudflare
       
 (DIR) Post #9yeJtZJQWzlAKi8cMK by thor@mstdn.social
       2020-08-30T13:27:27Z
       
       1 likes, 0 repeats
       
       @GNUxeava large parts of euro internet. failure at tier-1 isp Level3.
       
 (DIR) Post #9yeJwQsIMHoz26oSmW by href@pleroma.fr
       2020-08-30T13:27:04.926693Z
       
       0 likes, 0 repeats
       
       @quad @thor According to bgp.he most of the routes of Lyse goes thru Level3. So it definitely should have saturated some links and stuff at Lyse, or at NIX, or both. And I agree, 8888 shouldn't pass by Level3 nor Telia for Lyse (since google is at NIX) and Lyse too).
       
 (DIR) Post #9yeJwRDv3t7Q7AvjUG by href@pleroma.fr
       2020-08-30T13:28:40.040517Z
       
       0 likes, 0 repeats
       
       @quad @thor Also since Level3 wasn't respecting route withdrawals, as most ISP tried to shut down their links with Level3, that was resulting in blackholes... that aggravated the situation as well.
       
 (DIR) Post #9yeJwRaFiqz1ERNZIW by thor@mstdn.social
       2020-08-30T13:29:03Z
       
       0 likes, 0 repeats
       
       @href @quad where is this info coming from
       
 (DIR) Post #9yeJwRqClXkA1uqJA8 by href@pleroma.fr
       2020-08-30T13:29:45.748803Z
       
       0 likes, 1 repeats
       
       @thor @quad what i've seen on my routers, and also some network operating IRC channels, and https://puck.nether.net/pipermail/outages/2020-August/013198.html
       
 (DIR) Post #9yeJwS55sBeYm5oCMy by selea@social.linux.pizza
       2020-08-30T13:30:17Z
       
       0 likes, 0 repeats
       
       @href look like a MAJOR issue!@thor @quad
       
 (DIR) Post #9yeK1prUstEZye13Y0 by thor@mstdn.social
       2020-08-30T13:30:19Z
       
       1 likes, 0 repeats
       
       @GNUxeava see thread
       
 (DIR) Post #9yeKeabHYn5HwDuXOS by thor@mstdn.social
       2020-08-30T13:37:42Z
       
       0 likes, 0 repeats
       
       @href @selea did not even know telia had that thing you linked
       
 (DIR) Post #9yeKebYU0gRItpbofY by selea@social.linux.pizza
       2020-08-30T13:38:19Z
       
       0 likes, 0 repeats
       
       @thor telia is one of the biggest carrier in the world, so they have stuff like that - hidden from normies ofcourse.@href
       
 (DIR) Post #9yeKjsJD9DWMJ9yjlQ by thor@mstdn.social
       2020-08-30T13:39:16Z
       
       0 likes, 0 repeats
       
       @selea @href yes, and i knew of one such site, which let you look up the wire pairs and various data on phone lines in norway, commonly used by telco techs
       
 (DIR) Post #9yeLF05SHLI1POO0H2 by href@pleroma.fr
       2020-08-30T13:01:47.476254Z
       
       0 likes, 0 repeats
       
       @thor @quad yeah, 8.8.8.8 is anycast, so that usually means that your ISP will choose the shortest route. Maybe NIX has issues, or your ISP link to NIX, or Google link to NIX. Routing is weird, especially is that time where Level3 is shitting around.Lyse seems to have peering at NIX.
       
 (DIR) Post #9yeLF1HXpsYR7B3Aky by thor@mstdn.social
       2020-08-30T13:03:08Z
       
       0 likes, 0 repeats
       
       @href @quad it’s more... it has many moving parts and can get unpredictable at times...
       
 (DIR) Post #9yeLF1t7aAc0zidBKK by href@pleroma.fr
       2020-08-30T13:07:20.313138Z
       
       1 likes, 0 repeats
       
       @thor @quad yep. Also Level3 doesn't seem to withdraw routes today when other ISPs remove them, causing even more havoc. just go outside and wait for the internet-storm to finish, eh!
       
 (DIR) Post #9yeLK1GXK7wcVoxkDw by href@pleroma.fr
       2020-08-30T13:34:49.695761Z
       
       0 likes, 0 repeats
       
       @selea @thor  and it's still not resolved, take Telia to Online.net: https://lg.telia.net/?type=bgp&router=s-b5&address=62.210.16.2 there's still 3356 (Level3's AS Number) in the path, while Online have removed their Level3 routes a couple of hours ago.
       
 (DIR) Post #9yeLK1aO8Jp9VOFbAO by thor@mstdn.social
       2020-08-30T13:35:25Z
       
       0 likes, 0 repeats
       
       @href @selea do you work at an isp?
       
 (DIR) Post #9yeLK38SN8faJLCJuK by href@pleroma.fr
       2020-08-30T13:35:53.888298Z
       
       1 likes, 0 repeats
       
       @thor @selea no, I just like networking and play with it sometimes
       
 (DIR) Post #9yeLLHIhBy1AX6ZZQ0 by href@pleroma.fr
       2020-08-30T13:38:14.265367Z
       
       1 likes, 0 repeats
       
       @thor @selea looking glasses are really useful tools to debug networking issues. Wish more ISPs provided one.
       
 (DIR) Post #9yeLRlxi6dgfMir09w by thor@mstdn.social
       2020-08-30T13:39:38Z
       
       0 likes, 0 repeats
       
       @selea @href but i have no overview of this category of site.
       
 (DIR) Post #9yeLRnJj4GtLZIA676 by href@pleroma.fr
       2020-08-30T13:40:18.477377Z
       
       0 likes, 0 repeats
       
       @thor @selea usually try to find the AS number of the ISP, and ask google for "looking glass ASXXXX". Sometimes peeringdb.com entries got the link to it as well
       
 (DIR) Post #9yeLRo1KS9lnkWYv4q by thor@mstdn.social
       2020-08-30T13:42:36Z
       
       0 likes, 0 repeats
       
       @href @selea ah
       
 (DIR) Post #9yeLRpMzR6gtvzhjTk by href@pleroma.fr
       2020-08-30T13:43:48.286642Z
       
       0 likes, 1 repeats
       
       @thor @selea bgp.he.net also is a useful tool to see which provider a provider use, e.g. https://bgp.he.net/AS29695 (it's Lyse)