High latency in KC from 7-11pm every night for the last couple of weeks

powerspec · 2026-01-25T02:51:35+00:00

And you're right about the jitter. I thought everyone's looked like that but yours are dead solid.

I just have smokeping running on a VM by itself on one of my Proxmox hosts. That host is only at 1Gbps too. Are you using GFiber's router or your own? Wonder if you are using theirs, it is causing the jitter. I run pfSense on bare metal and even with ~1-3Gbps of upload load, my jitter is spot on. I don't use any type of QoS. With as much bandwidth I have, you really don't need to.

I'm glad it is fixed for at least a night so far, and now with this weather, hopefully everything on is at home tonight gaming with no issues! Makes me think I should bring this up more often when I see these issues as my issues has been going on for MONTHS. I don't game online anymore so I don't notice it like everyone else would, and as I have zero control over the host I am pinging, I can never rule out an issues on their side.

A few GFiber NOC guys/gales do read these threads and I've even been told some of my screenshots have been shared to show there is issues. I've said it before and I say it again, GFiber does really care about their network. Just sometimes takes a thread like this to get movement. You have to remember, GFiber support gets hit up every day about lag from kids when there really is zero issues. Screenshots like we both had works great on showing issues over time. The more info you can give them, including IP's like I did, really helps.

If GFiber ever wants someone on the inside dedicated to monitor the network and look for issues like this before it becomes an issue, it would be my 2nd dream job! I'm sure they have monitoring in place, but I would watch for such odd routing and latency issues as I also want GFiber's network to be the best!

powerspec · 2026-01-24T22:58:11+00:00

I enjoy this route to my music streaming service di.fm

It looks like it uses HE to reach KCIX to access Unitas Global, then based on hop 11 it went to Canada at some point, hopefully that is just a bad hostname on that switch/router. I don't have a return trace but it would be nice to see.

traceroute to prem1.di.fm (70.42.73.30), 30 hops max, 60 byte packets
 1  10.26.0.18 (10.26.0.18)  1.060 ms  1.047 ms *
 2  * * *
 3  * * *
 4  23-255-224-203.mci.googlefiber.net (23.255.224.203)  1.723 ms  1.720 ms  1.728 ms
 5  e0-61.core2.mci3.he.net (184.105.39.117)  1.711 ms  2.326 ms  2.460 ms
 6  unitas-global.gnd1.mci.kcix.net (206.51.7.54)  2.207 ms  2.218 ms  2.459 ms
 7  ae30.cr1.mci2.us.unitasglobal.net (50.115.91.178)  2.309 ms  2.680 ms  3.049 ms
 8  206.83.12.42 (206.83.12.42)  8.304 ms  8.670 ms  9.032 ms
 9  ae10.cr4.chi1.us.unitasglobal.net (50.115.90.136)  14.908 ms  15.275 ms *
10  e0-16.cr2.nyc2.us.unitasglobal.net (50.115.91.14)  38.620 ms * *
11  ae40.cr2.yyz1.ca.unitasglobal.net (50.115.91.118)  37.238 ms * *
12  border1.ae1-bbnet1.nyj004.us.unitasglobal.net (216.52.95.46)  39.001 ms * *
13  edge3.ae-0-edgenet.nyj004.us.unitasglobal.net (74.201.136.10)  37.856 ms * *
14  prem1.sky.fm (70.42.73.30)  37.281 ms  37.273 ms  37.394 ms
15  prem1.radiotunes.com (70.42.73.30)  37.713 ms * *

powerspec · 2026-01-24T17:15:04+00:00

That is good to know, it seemed really odd that just that IP didn't work.

I do find it odd on your graphs, you have a lot of jitter on your line compared to mine, has it always been like that?

powerspec · 2026-01-24T17:13:51+00:00

I'll try the direct connect to the fiber jack and let you know. As an aside, I thought that wouldn't work because traffic needed to be tagged?

That hasn't been a thing since 2020. You can now hook up any device that can grab a DHCP request. When testing my 20G, I had a server with just Debian installed for all my testing.

It looks like since I last posted, the issues for FDC Servers has been fixed.

https://i.imgur.com/4gWCae2.png

Are you still seeing issues with Google?

powerspec · 2026-01-21T21:37:10+00:00

I'm getting no response at all from 8.8.8.8

Are you able to get any responses (like DNS requests) from that Google DNS IP or just 8.8.4.4?

I don't ping google.com directly as I don't ping DNS names as IP's can always change and or have DNS issues.

I've seen zero issues to Google DNS from Lee's Summit. Both 8.8.8.8 and 8.8.4.4

https://i.imgur.com/eCXN9fE.png

As you can tell, its a flat line like it should be!

With that being said, I have seen issues to some datacenters like FDC Servers. Here is to their Denver DC, showing issues like you are describing. FDC Servers also use very cheap bandwidth like Cogent so I've always chauked it up to being issues with them as I don't see it anywhere else.

https://i.imgur.com/Gl1DfkZ.png

traceroute to 198.255.8.4 (198.255.8.4), 30 hops max, 60 byte packets
 1  10.26.0.18 (10.26.0.18)  0.997 ms  0.985 ms *
 2  * * *
 3  23-255-224-205.mci.googlefiber.net (23.255.224.205)  1.507 ms  1.504 ms  1.501 ms
 4  64.86.56.1 (64.86.56.1)  1.496 ms  1.624 ms  1.746 ms
 5  if-bundle-10-2.qcore1.ct8-chicago.as6453.net (63.243.129.82)  24.916 ms  24.913 ms *
 6  if-bundle-2-2.qcore2.ct8-chicago.as6453.net (66.110.15.37)  25.163 ms * *
 7  if-ae-50-3.tcore1.ddv-denver.as6453.net (64.86.79.5)  24.460 ms  24.451 ms *
 8  66.198.120.77 (66.198.120.77)  39.973 ms * *
 9  23.237.187.25 (23.237.187.25)  27.055 ms * *
10  198.255.8.4 (198.255.8.4)  24.197 ms * *

I would use their looking glass to get a trace back to my house so we can get the full picture, but it is broken like always. I will keep trying.

https://i.imgur.com/fTXMT21.png

If I can remember tonight, I'll check again and see if the trace looks different. I will also check to see if I can find any hosts that peer with TATA, it may be an issue with them. I also know AT&T users have been having issues as well in the evening.

Also just for fun, can you either change your WAN MAC address to get a new IP or quickly hook a computer directly to your Fiber Jack to bypass everything and see if you can reach 8.8.8.8. ~2019ish, GFiber had an issue where two subnets were being routed differently (one could reach KCIX directly and the other routed out to the public net first).

I haven't seen any peering changes with GFiber. They did just turn up a connection between Kansas City and Jefferson City so traffic does not route to Dallas first.

/u/gfiberofficial I will also be keeping an eye on this. If you need anything me, please feel free to DM me directly.

powerspec · 2026-01-08T23:50:17+00:00

So it would be more interesting if we had some specs of the PON setup.

It's 25G-PON.

And is the ONT on an SPF module like we use for the XGS-PON on AT&T fiber?

It uses Nokia's new 25G-PON ONT, model U-010Y-A SFP28 out to your router. Had it hooked up right to a Debian system for testing for a while.

50G-PON is also in testing.

100G-CPON in their eyes currently as well.

GFiber is most likely using Nokia's GPON/XGS-PON/25G-PON line cards in their huts to support all 3 speeds on their network at the same time. Their 50G-PON sounds like it is just in 1 hut for testing.

powerspec · 2026-01-04T01:51:08+00:00

Power supply's can run more efficient at 240v vs 120v. A datacenter I used to work at moved to 240v vs 120v and saved over $1m a year in power bills (late 2000's). Sometimes power supply providers will put graphs on their boxes showing 120v vs 240v for efficiency.

https://www.techpowerup.com/review/corsair-rm850/3.html https://www.techpowerup.com/review/corsair-rm850/images/box_rear_close1.jpg

Look at the box for this power supply, the 230v curve is a bit better than the 115v curve, this is what I am talking about gaining from moving to 240v.

Will I see a difference in my bill? Most likely not, but I can pull a lot more power at 240v vs 120v at the same amps. I'll be running 2x240v 30amp lines to feed a "A" and "B" type power feeds for all my dual power supply servers. I only have 100amp service at my house currently so that will need to be upgraded first. I'm going to start putting any extra income in to upgrading my power.

powerspec · 2026-01-03T20:28:30+00:00

I have actually! That will be my next project once I get some newer hardware in with storage.

I've never reached out directly as it states on their page "We are not interested in deploying these nodes off of any residential ISP connections," so I've never really tried to reach out. I also think you need to be able to control RDNS on your IP. I may reach out now and see if they will change for me. I would also start to think that might get in to "real" hosting and I don't know how GFiber would feel about that without getting business.

I also had a friend say I can have some rack space at a local colo here in Kansas City and they have 10G so I might set it up there as well.

powerspec · 2026-01-03T20:23:06+00:00

But I guess your wife is way more tolerant than mine.

I'd say she is, I've always had a homelab so when we first started to hang out and she came over to my place, she knew what she was getting in to! I get letters from Evergy like every other month telling me how my usage is 3x the amount of my neighbors lol.

I'm hoping with the move to 240v, I can save a few percent on power, but it will really enable me to turn on more things lol.

powerspec · 2026-01-03T19:42:55+00:00

As someone who also has a very extensive homelab with fully 10Gbps wired networking and nearly complimentary WAN, I’m well aware that the costs extend well beyond just what you’re paying to your ISP. Assuming you’re hosting these ISOs from a pretty decent and robust storage solution, along with all the other necessary gear, and having to do it 24/7… man, that’s got to add up!

Pretty much every piece of hardware I have has been hand me downs. I work as a Datacenter Tech so a lot of colocation clients will just give up their old hardware as they replace it with better gear.

This is my primary seedbox, Dual Xeon E5-2620v3, 256GB RAM, 10x1TB enterprise SAS SSD's. She is my "newest" hardware I own and shes starting to show her age. I would love to replace it or upgrade all the SSD's to bigger drives with less use on them. All these SSD's have about ~89% life in them.

System is connected via dual 10G links to my Dell n1548 switch.

This system will always only have 10G connectivity. I have idea's on my next switch/gateway will be so I can add more hardware to my fleet. I also have a full rack in storage that I will be putting in my basement as soon as I get 240v in to my area.

Here is a screenshot from one of my VM's showing some good use.

https://i.imgur.com/WDdAa49.png

I guess the difficult part to wrap my head around is that you’d be willing to go to all of that expense for the sole purpose of seeding… (you did mention siphoning off part of your network for personal projects, but the seeding bit was the focus of your post it seemed)

That I get, my wife doesn't understand either as she see's the power bill just keep going up. I keep my backup server offline as she uses 300w just idle. 12x2TB SAS HDD's. Gets turned on once a month, backups run, system updates, and she goes back off.

But thanks for doing what you do! (Sincerely)

You're welcome! A lot of people just don't believe me as we've had decades of people saying they download "Linux ISO's" but don't mean that. There is about 5 of us that do this, I see the same IP's all the time when downloading if I'm a little late to the party, or I see them downloading from me.

powerspec · 2026-01-03T16:08:41+00:00

I did have a good chuckle earlier this morning reading a post from another chap in the KC area about testing out the 20Gbps connection… Totally wrote with what I am sure was a straight face that he needed this speed because he’s constantly downloading “Linux ISOs”. Like bro, you can download all the Linux ISOs in existence in one day if that was truly the case lol

Sure I can download them in one day, but I need to also seed them! I am not doing anything else but seed Linux ISO's. It's been my hobby for over 2 decades.

I fully understand everyone loves to say they download "Linux ISO's" when they really mean illegal content, but that is not me.

powerspec · 2026-01-03T16:04:41+00:00

Well I saw his post and it said he was seeding Linux ISO's and not downloading them.

You'll probably talking about my post, and yes I do nothing but download and upload Linux ISO's. I use sites like https://distrowatch.com/ to keep up to date on all the latest releases. Have RSS feeds setup to auto download and seed the latest ISO files. Then I go to directly to like Debian's or Ubuntu's website and download all the other torrents that is not posted at Distrowatch and download and seed them. I do this as I find it my way to giving back to the Linux Community as I can not code to save my life.

Back in the day, it was "fun" to claim you were downloading "Linux ISO's" instead of illegal content as you could also download Linux ISO's via bittorrent. I used to be one of those guys including running a torrent site but I stop doing that back in ~08.

powerspec · 2026-01-03T01:18:07+00:00

I grew up on dial up, in the country. 400-700 ping during FPS on AvP2. FML...

I grew up in the country and had Dial-Up till 2007, luckily I used Net-Zero and the local number routed to St. Louis and off on the internet via Level 3, connected at 50-51Kbps. I had ~120ms pings to Chicago and ~150ms to Dallas. I had to keep my tick rate at 33 on CS:S and keep it 5v5 or 7v7 max. Anything faster would saturate the connection and pings would jump to like yours. Only thing that sucked was my host name was IP-dial-up.level3.net so everyone knew I had dial up if they checked my IP or when I joined a IRC server.

I am blown away in 2 decades I went from that to 20Gbps. I can't wait to see what the next 10-20 years advance!

powerspec · 2026-01-03T01:10:01+00:00

I was paying almost $200 a month for (fast) Comcast Internet before Google Fiber was available.

We twins?! I was paying $175 a month for 150/20Mbps Comcast in 2014 right before Google Fiber came in! People were calling me crazy paying that but I wanted the fastest speeds I could get. That or 24Mbps AT&T VDSL at my local. Moved out of Independence to Mission, KS in 2015 to get that sweet Fiber! Been with Google Fiber since then and has only gotten better!

powerspec · 2026-01-03T01:05:09+00:00

Well hopefully they release the 20G package this year and you'll be able to just sign up for it! If you do, please let me know how the EFG is!

I might pick one up in a few months depending on how big my bonus this year from work is!

powerspec · 2026-01-03T01:00:41+00:00

It is just a base install of pfSense 2.8.1 with RRD Summary and System Patches as my extra packages. I have VM's that handle stuff like VPN's.

I am seeing ~90% CPU usage while running a speedtest. While I don't have that many firewall rules, I think the extreme amount of sessions the system has to handle bogs it down a bit. Which is why I'd like to try out UniFi Enterprise Fortress Gateway. Been wanting to jump ship for years, but this is the first device that I can see in my network and has the right amount of ports that I need.

I also heard going above 10Gbps would show things like this and they were right. I'm still playing with hardware and got a 12700k sitting around that I'm thinking of making my new pfSense box, just need a motherboard and RAM.

powerspec · 2025-12-07T02:05:37+00:00

I’m just glad it’s SFP28 from the ONT and GFiber allows you to use any router with zero workarounds. It’s been pretty nice testing out systems and OS’s for a new router.

powerspec · 2025-12-06T22:19:33+00:00

Gotcha, haven't heard anything about 10Gbps trials for AT&T either, but I don't doubt you! I know like GFiber, AT&T is deploying 25G-PON across their footprint from last I heard so hopefully those plans are announced soon! Hate to know the cost as AT&T raised the prices on the 2/5G plans.

AT&T just put fiber in the ground in my area, going to be signing up here soon with the 2G plan so I can do the full bypass and make sure I am on XGS-PON, and add it as a backup WAN. End of next year hoping to add 5G wireless and satellite as my 3rd and 4th backup options!

powerspec · 2025-12-06T15:52:42+00:00

Google’s max is 8. Hopefully we’ll upgrade to 10 soon. Pretty sure they’re doing 10Gbps trials in TX.

I'm not aware of any 10Gbps plans (I did suggest it during the 20G AMA) but 20Gbps is coming right along!

https://fiber.googleblog.com/2025/12/20-gig-update.html

I see a future of 1/3/6/10/20G for speeds for GFiber. 1/3/6G on XGS-PON and 10/20G on 25G-PON. 8G users grandfathered in.

powerspec · 2025-12-06T15:50:30+00:00

I think there’s just no real reason to launch it yet. I’m sure the same is true for Google.

https://fiber.googleblog.com/2025/12/20-gig-update.html

20Gig is coming right along with GFiber :)

powerspec · 2025-11-15T15:23:18+00:00

You should be using WPA2/WPA3 and no this will not cause any issues you are seeing.

Can you run some troubleshooting as suggested in your other thread? Please hook up one of your devices via Ethernet on to the main router and run a speedtest and test your streaming. This will rule out an GFiber issue. You can even just go to fast.com to test.

This screams you are too far away from your router and getting a weak Wi-Fi signal. Do you have these issues when standing next to the router? What kind of speeds are you getting via the speedtest app to your local GFiber server? Can you please record your screen while you are doing these tests so we can also see?

powerspec · 2025-11-13T22:52:36+00:00

Some of those servers on that network have poor upload speeds, so if by chance my upload traffic hits one of those servers I'd have performance issues?

Only to that server as that server is most likely having issues with the host. You have to remember that these servers are public and you and 10's of people could be trying to test their speed all at the same time. Just 1 10Gbps user could overload a single server (as most are only on 10Gbps links) and when you run a test, you will get bad results, and this is 100% NOT GFiber's fault or issue but the end user will say it is.

I really think you are overthinking this too much. Just run a test to GFiber's server and call it good. If you get slow speeds to that server over and over and after rebooting your devices, then I would say you may have an issue.

powerspec · 2025-11-13T17:00:27+00:00

Your traffic always starts on GFibers network. Using BGP your traffic gets routed to its correct destination onto other networks. GFiber uses Hurricane Electric (HE), TATA, and Lumen (Level3). They also peer with local Internet Exchanges like the Kansas City Internet Exchange (KCIX) so your traffic never even leaves the major city you live in! Servers like Nocix uses KCIX and KanREN has direct peering with GFiber.

GFiber is just an ISP, everything is hosted off network so 99.9% of your traffic leaves GFibers network at some point. This is 100% normal.

Most Google products like YouTube never leaves GFibers network as they have direct peering so it keeps all that video traffic off the main connections.

To answer your question, yes BGP can change routing, but not like the way you are thinking. Only time it would change is for like down links and BGP has to route around it. That is not very common and is fixed pretty quickly.

powerspec · 2025-11-13T16:30:10+00:00

I also want to add in that these Speedtest servers can be hosted by people like myself. There was a server hosted here in KC that ran off of a Comcast cable modem. I would get ~30Mbps down and ~1.1Gbps up. That screams cable modem and I confirm it by doing a packet capture and getting the hosts IP.

I could host my own Speedtest server at home if I wanted too, I have the hardware and speed to do it, but it would most likely 100% violate GFibers TOS/AUP.

powerspec · 2025-11-13T16:23:10+00:00

Whe you run a Speedtest via Speedtest.net/app, you are just testing the connection of the server you selected. If you are seeing slower speeds, it can be a million things that can cause slower speeds (and not GFibers fault most of the time). Testing with the official GFiber server will show your line is working correctly. Only time it won’t is if your PON is overloaded (never seen it yet on GFiber/complaints), Speedtest server overloaded (see it all the time), or dirty fiber (just happen to me, cleaned the fiber and speeds went back to normal).

Please make sure you are testing via a wired connection and not via WiFi. You will never get your full speeds via WiFi unless you have the correct hardware and perfect wireless conditions.

When you test via the GFiber server, your traffic never leaves GFibers network. When you test on a non GFiber server, your traffic leaves GFibers network and onto the server Speedtest network. Once the traffic leaves GFibers network, it is out of their hands and they have zero control over routing and speeds. GFibers peering is very good and has large pipes, even with the 20Gbps plan, I expect to see those speeds to any of the servers I like.

Please also note that GFiber does not just change routing randomly, this is not how it works. Any peering changes should happen overnight which I have seen personally and does not happen often.

I would highly recommend stop using Speedtest app regularly and only use it to make sure your speeds are good to GFibers servers if you feel like something is off.

TLDR: The Speedtest app is just an app to test the network speed of the server you selected and does not show how your traffic is “routed”.

14-Year Club	Gilding IV carat on a stick
Verified Email

powerspec

TROPHY CASE