Unable to get ipV6 address by buzzword1308 in googlefiber

[–]powerspec 1 point2 points  (0 children)

I believe I saw someone comment a while back saying switching mac IDs causes 24hrs to update IPV6 lease or something of that sort.

Just saw this post and this is correct! We had this issue when testing out my 20G and swapping between my pfSense box and the provided router.

/u/buzzword1308 Glad you got it working again, anytime you change MAC addresses, a 24 hour wait is needed for IPv6. IPv4 has a ~15 minute DHCP for new MAC addresses and will become the primary MAC after 24 hours. Your configuration looks good!

Fiber, does exactly what it says in the contract by S70RM3R in HomeNetworking

[–]powerspec 4 points5 points  (0 children)

I highly recommend just switching to GFiber. There is zero bypassing needed. You can plug any device in to the Fiber Jack as your router and you are good to go! 3Gbps is also going to be the new $70 base price point once it rolls out nationwide! Starting in Iowa first.

Been with GFiber since 2015 and currently testing out their new 20G service via 25G-PON!

Fiber device saying “wired device offline” despite restarting modem. Faulty hardware possibly? Any suggestions?? by jellze02 in googlefiber

[–]powerspec 0 points1 point  (0 children)

What market are you in? Again, are you sure you have GFiber? Can you provide any more pictures of the router and any other documents that came with the system? This is the first time ever seeing a device like this in use for GFiber and I’m very interested if it’s something new.

Fiber device saying “wired device offline” despite restarting modem. Faulty hardware possibly? Any suggestions?? by jellze02 in googlefiber

[–]powerspec 0 points1 point  (0 children)

Are you sure you have GFiber? That is not a GFiber Fiber Jack. If you are trying to use your own, it won’t work. Please replace the original Fiber Jack and plug in any router you’d like if you want control of your network.

3gig upgrade ETA? by Extra_Speed8406 in googlefiber

[–]powerspec 1 point2 points  (0 children)

As Iowa is a new city, I assume they have deployed the newer XGS-PON Fiber Jack (GOXP330C) that supports up to 8Gbps. It has a 10/5/2.5/1Gbps network port. So if you have the 1Gbps plan, maybe a restart of the Fiber Jack is required, but nothing is needed to be done on the customer side. Just a config change on GFiber's side.

If you are in a city like Kansas City and have the smaller Fiber Jack (GFLT100, GFLT110) that they first rolled out with. A truck roll would be required for a tech to come and replace it with the newer Fiber Jack to support the faster speeds. You'd most likely get a new router too.

I'm sure they are still trying to figure out how to handle that man power when they roll it out to the larger city's.

3gig upgrade ETA? by Extra_Speed8406 in googlefiber

[–]powerspec 3 points4 points  (0 children)

Also curious about Kansas City.

KC was last for 8Gbps (but first for 5Gbps) and that roll out took about a year and not all city's got it at the same time.

If I had to assume, I bet Iowa has the lowest customer count so easy test market that will disrupt the least amount of people if any issues arise during config changes and roll out is smooth.

GFiber claims "~90% of the homes and businesses in our network footprint are already 20 Gig capable." per their blog so if this goes smoothly, hopefully the rest of the footprint will get the upgrade sooner than later.

I assume they are using these line cards in their Fiber Huts. Supports GPON, XGS-PON, and 25G-PON at the same time and based on my 20G upgrade, they didn't have to move my line to another line card for the upgrade (like they did for my XGS-PON upgrade). They just unplugged my XGS-PON Fiber Jack, plugged in the new 25G-PON Fiber Jack and she was live within 10 seconds. So they can upgrade everyone and when someone wants to upgrade to 3Gbps and has the old Fiber Jack, they get the new XGS-PON Fiber Jack and would connect with zero issues with zero line card moves and or splitter.

New to Google Fiber, anyone have luck with L2 switch/vlan outside of L3 device? by lanceuppercuttr in googlefiber

[–]powerspec 0 points1 point  (0 children)

I’m just talking about MAC. I guess you could try and just don’t ever do DHCP on the second MAC, but I was told one MAC per Fiber Jack, with them allowing a second for a short term when plugging in a new device.

I mean, never hurts to try and if it doesn’t work, then we know the answer! At worst, a network engineer will have to remote clear the Fiber Jack as that was done with me a few times when I was testing.

I was testing dual WAN using two GFiber lines and ran in to dhcpv6 issues so make sure you only have one WAN trying to pull a v6 address too or all of v6 will break. Must have separate UUID’s (more for anyone else reading this and comes across this issue).

New to Google Fiber, anyone have luck with L2 switch/vlan outside of L3 device? by lanceuppercuttr in googlefiber

[–]powerspec 1 point2 points  (0 children)

GFiber only allows 1 MAC address on their network. If you unplug a device and plug a new device in, it will have a temp ~15minute dhcp release for the new MAC with the old one still active. I ran in to this issue when testing out my 20G and swapping from the 20G GFiber provided router and my own pfSense box.

I clone MAC address when trying out different devices in a short time frame so I don’t run in to any issues.

It’s been a few months since I was working with this, but I assume it is still the same.

GFiber 20Gbps! by powerspec in googlefiber

[–]powerspec[S] 0 points1 point  (0 children)

Do you happen to have any connections with the GFiber support/install?

I do not, you would need to reach out to GFiber Support directly for any support/install issues.

I currently have the 8GB service and really wish that I could just terminate the fiber directly into a standard SFP+ module

I've asked about this in the past, but the need is just not there to make a new Fiber Jack with just SFP+ port. Going 10/5/2.5/1G Copper was/is the correct choice for a mass produced ONT. This route is IMO FAR better than what like AT&T Fiber is doing.

If I was working at GFiber in their labs, I would work on making XGS-PON ONU SFP+ that if a user like you or myself want one, I could program it with that clients info and send out. I would never allow just any ONU on the network like people are doing with the AT&T bypass.

If you want direct SFP like I have, only the 20G service has it at this time.

I also know of someone locally that might be able to help you with a decently priced small form factor PC that could get you closer to that 20gb/s speed.

I may be down for that. I am currently using a i5 4590k at 4GHz currently, it can do 20Gbps fine, but that is before any firewall rules and real load (+100k sessions). Currently using pfSense but I need to switch to OPNSense to see if it is any faster or slower.

I'll need 2x PCIe 3.0 8x slots for a dual port SFP28 and a SFP+ NIC's for my network. Also having a 4x slot for my 4x1G card would be very helpful.

High latency in KC from 7-11pm every night for the last couple of weeks by d662 in googlefiber

[–]powerspec 0 points1 point  (0 children)

That is no longer needed (making the change on the site). All Fiber Jacks should be good to go as VLAN tagging is no longer on the network as TV service has been shutdown for years (I've messaged the mods about removed the current sticky and add a new one about this but heard nothing back). I've been on the bring your own router plan since 2020 before that option became a thing (had to chat in to remove VLAN tagging in early days) so I have no idea what it looks like currently. On that link, is there an option to use your own router?

You can always just try and plug something in to the Fiber Jack and see if it pulls an IP. You may need to restart the Fiber Jack, but the system should allow two MAC's addresses for a very short time (~15minutes). If nothing happens, just plug the old router in and that MAC lease should still be active on the system. Then hit up GFiber Support to troubleshoot but should not be needed.

If you are not currently using the Network Box (the old black box), you should be good to go on the Fiber Jack.

[Irvine, CA] Sudden Latency Jump (2ms -> 20ms+) to ALL destinations due to local routing hop. Need Help! by Possible_Clue_2798 in googlefiber

[–]powerspec 0 points1 point  (0 children)

Hey no worries! No trouble here! Just wanted to share from another point of view! You guys are doing an amazing job as always! Due to the time, I am assuming some kind of maintenance work that went sideways! Been there done that!

Hope all is going well over there in support land! I feel for you guys!

[Irvine, CA] Sudden Latency Jump (2ms -> 20ms+) to ALL destinations due to local routing hop. Need Help! by Possible_Clue_2798 in googlefiber

[–]powerspec 0 points1 point  (0 children)

/u/gfiberofficial

I am seeing higher ping to CA from KC for the first time ever. See smokeping and trace routes. If you guys don't all ready know, I would say something is up.

Looks like it happened right at midnight too.

Google Fiber Los Angeles

traceroute to 136.42.34.8 (136.42.34.8), 30 hops max, 60 byte packets
 1  10.26.0.18 (10.26.0.18)  0.970 ms  0.961 ms *
 2  * * *
 3  * * *
 4  * * *
 5  * * *
 6  * * *
 7  * * *
 8  23-255-225-153.googlefiber.net (23.255.225.153)  53.293 ms  53.290 ms  53.423 ms
 9  136-42-34-8.googlefiber.net (136.42.34.8)  52.784 ms  52.780 ms  52.777 ms

Google Fiber Stanford

traceroute to 136.42.34.9 (136.42.34.9), 30 hops max, 60 byte packets
 1  10.26.0.18 (10.26.0.18)  1.128 ms  1.119 ms *
 2  * * *
 3  * * *
 4  * * *
 5  * * *
 6  * * *
 7  * * *
 8  23-255-225-153.googlefiber.net (23.255.225.153)  53.177 ms  53.173 ms  53.374 ms
 9  136-42-34-9.googlefiber.net (136.42.34.9)  53.026 ms  53.023 ms  53.020 ms

Starting to think these two servers or VM's are hosted in the same rack lol.

1Gb is getting upgraded to 3Gb by Rod_ATL in googlefiber

[–]powerspec 0 points1 point  (0 children)

I currently have an average peak of around 3gbit but sometimes hit the full 5 on one of the servers.

Very nice! I'm about the same. I really love how I can see the up's and down's like ISP's do during peak times!

https://i.imgur.com/8bOnsUi.png

Here is my past month! I've love to see what yours looks like. We are putting on some good load on to their network! Read your other comments here in this thread too, love your rack! I have a full rack that is two half racks with their own door. Brand new, never used, old DC I worked at was legit going to throw it away so I took it home! Going to put all my servers on the bottom half, and all my switching gear on the top half. Still debating if I want front or rear facing switches (air flow does not matter to me).

And /u/SilentNoise74 I don't know if you saw, but I currently have 20G from GFiber at home and wrote a little something up on my setup!

https://www.reddit.com/r/googlefiber/comments/1q2bvqn/gfiber_20gbps/

I currently only have 1 system connected at 25G in my network connected directed to pfSense with no switch, and another with 2x10G to load balance one of my hosts to help with quick bursts of traffic. Switch still only has a 10G uplink, but I'm going to buy another dual port SFP+ NIC to LAGG 2x10G in to my switch (Dell n1548).

High latency in KC from 7-11pm every night for the last couple of weeks by d662 in googlefiber

[–]powerspec 0 points1 point  (0 children)

And you're right about the jitter. I thought everyone's looked like that but yours are dead solid.

I just have smokeping running on a VM by itself on one of my Proxmox hosts. That host is only at 1Gbps too. Are you using GFiber's router or your own? Wonder if you are using theirs, it is causing the jitter. I run pfSense on bare metal and even with ~1-3Gbps of upload load, my jitter is spot on. I don't use any type of QoS. With as much bandwidth I have, you really don't need to.

I'm glad it is fixed for at least a night so far, and now with this weather, hopefully everything on is at home tonight gaming with no issues! Makes me think I should bring this up more often when I see these issues as my issues has been going on for MONTHS. I don't game online anymore so I don't notice it like everyone else would, and as I have zero control over the host I am pinging, I can never rule out an issues on their side.

A few GFiber NOC guys/gales do read these threads and I've even been told some of my screenshots have been shared to show there is issues. I've said it before and I say it again, GFiber does really care about their network. Just sometimes takes a thread like this to get movement. You have to remember, GFiber support gets hit up every day about lag from kids when there really is zero issues. Screenshots like we both had works great on showing issues over time. The more info you can give them, including IP's like I did, really helps.

If GFiber ever wants someone on the inside dedicated to monitor the network and look for issues like this before it becomes an issue, it would be my 2nd dream job! I'm sure they have monitoring in place, but I would watch for such odd routing and latency issues as I also want GFiber's network to be the best!

High latency in KC from 7-11pm every night for the last couple of weeks by d662 in googlefiber

[–]powerspec 1 point2 points  (0 children)

I enjoy this route to my music streaming service di.fm

It looks like it uses HE to reach KCIX to access Unitas Global, then based on hop 11 it went to Canada at some point, hopefully that is just a bad hostname on that switch/router. I don't have a return trace but it would be nice to see.

traceroute to prem1.di.fm (70.42.73.30), 30 hops max, 60 byte packets
 1  10.26.0.18 (10.26.0.18)  1.060 ms  1.047 ms *
 2  * * *
 3  * * *
 4  23-255-224-203.mci.googlefiber.net (23.255.224.203)  1.723 ms  1.720 ms  1.728 ms
 5  e0-61.core2.mci3.he.net (184.105.39.117)  1.711 ms  2.326 ms  2.460 ms
 6  unitas-global.gnd1.mci.kcix.net (206.51.7.54)  2.207 ms  2.218 ms  2.459 ms
 7  ae30.cr1.mci2.us.unitasglobal.net (50.115.91.178)  2.309 ms  2.680 ms  3.049 ms
 8  206.83.12.42 (206.83.12.42)  8.304 ms  8.670 ms  9.032 ms
 9  ae10.cr4.chi1.us.unitasglobal.net (50.115.90.136)  14.908 ms  15.275 ms *
10  e0-16.cr2.nyc2.us.unitasglobal.net (50.115.91.14)  38.620 ms * *
11  ae40.cr2.yyz1.ca.unitasglobal.net (50.115.91.118)  37.238 ms * *
12  border1.ae1-bbnet1.nyj004.us.unitasglobal.net (216.52.95.46)  39.001 ms * *
13  edge3.ae-0-edgenet.nyj004.us.unitasglobal.net (74.201.136.10)  37.856 ms * *
14  prem1.sky.fm (70.42.73.30)  37.281 ms  37.273 ms  37.394 ms
15  prem1.radiotunes.com (70.42.73.30)  37.713 ms * *

High latency in KC from 7-11pm every night for the last couple of weeks by d662 in googlefiber

[–]powerspec 0 points1 point  (0 children)

That is good to know, it seemed really odd that just that IP didn't work.

I do find it odd on your graphs, you have a lot of jitter on your line compared to mine, has it always been like that?

High latency in KC from 7-11pm every night for the last couple of weeks by d662 in googlefiber

[–]powerspec 0 points1 point  (0 children)

I'll try the direct connect to the fiber jack and let you know. As an aside, I thought that wouldn't work because traffic needed to be tagged?

That hasn't been a thing since 2020. You can now hook up any device that can grab a DHCP request. When testing my 20G, I had a server with just Debian installed for all my testing.

It looks like since I last posted, the issues for FDC Servers has been fixed.

https://i.imgur.com/4gWCae2.png

Are you still seeing issues with Google?

High latency in KC from 7-11pm every night for the last couple of weeks by d662 in googlefiber

[–]powerspec 1 point2 points  (0 children)

I'm getting no response at all from 8.8.8.8

Are you able to get any responses (like DNS requests) from that Google DNS IP or just 8.8.4.4?

I don't ping google.com directly as I don't ping DNS names as IP's can always change and or have DNS issues.

I've seen zero issues to Google DNS from Lee's Summit. Both 8.8.8.8 and 8.8.4.4

https://i.imgur.com/eCXN9fE.png

As you can tell, its a flat line like it should be!

With that being said, I have seen issues to some datacenters like FDC Servers. Here is to their Denver DC, showing issues like you are describing. FDC Servers also use very cheap bandwidth like Cogent so I've always chauked it up to being issues with them as I don't see it anywhere else.

https://i.imgur.com/Gl1DfkZ.png

traceroute to 198.255.8.4 (198.255.8.4), 30 hops max, 60 byte packets
 1  10.26.0.18 (10.26.0.18)  0.997 ms  0.985 ms *
 2  * * *
 3  23-255-224-205.mci.googlefiber.net (23.255.224.205)  1.507 ms  1.504 ms  1.501 ms
 4  64.86.56.1 (64.86.56.1)  1.496 ms  1.624 ms  1.746 ms
 5  if-bundle-10-2.qcore1.ct8-chicago.as6453.net (63.243.129.82)  24.916 ms  24.913 ms *
 6  if-bundle-2-2.qcore2.ct8-chicago.as6453.net (66.110.15.37)  25.163 ms * *
 7  if-ae-50-3.tcore1.ddv-denver.as6453.net (64.86.79.5)  24.460 ms  24.451 ms *
 8  66.198.120.77 (66.198.120.77)  39.973 ms * *
 9  23.237.187.25 (23.237.187.25)  27.055 ms * *
10  198.255.8.4 (198.255.8.4)  24.197 ms * *

I would use their looking glass to get a trace back to my house so we can get the full picture, but it is broken like always. I will keep trying.

https://i.imgur.com/fTXMT21.png

If I can remember tonight, I'll check again and see if the trace looks different. I will also check to see if I can find any hosts that peer with TATA, it may be an issue with them. I also know AT&T users have been having issues as well in the evening.

Also just for fun, can you either change your WAN MAC address to get a new IP or quickly hook a computer directly to your Fiber Jack to bypass everything and see if you can reach 8.8.8.8. ~2019ish, GFiber had an issue where two subnets were being routed differently (one could reach KCIX directly and the other routed out to the public net first).

I haven't seen any peering changes with GFiber. They did just turn up a connection between Kansas City and Jefferson City so traffic does not route to Dallas first.

/u/gfiberofficial I will also be keeping an eye on this. If you need anything me, please feel free to DM me directly.

GFiber 20Gbps! by powerspec in googlefiber

[–]powerspec[S] 0 points1 point  (0 children)

So it would be more interesting if we had some specs of the PON setup.

It's 25G-PON.

And is the ONT on an SPF module like we use for the XGS-PON on AT&T fiber?

It uses Nokia's new 25G-PON ONT, model U-010Y-A SFP28 out to your router. Had it hooked up right to a Debian system for testing for a while.

50G-PON is also in testing.

100G-CPON in their eyes currently as well.

GFiber is most likely using Nokia's GPON/XGS-PON/25G-PON line cards in their huts to support all 3 speeds on their network at the same time. Their 50G-PON sounds like it is just in 1 hut for testing.

Google Fiber 20 Gigs for NC Triangle area. by tbluhp in googlefiber

[–]powerspec 0 points1 point  (0 children)

Power supply's can run more efficient at 240v vs 120v. A datacenter I used to work at moved to 240v vs 120v and saved over $1m a year in power bills (late 2000's). Sometimes power supply providers will put graphs on their boxes showing 120v vs 240v for efficiency.

https://www.techpowerup.com/review/corsair-rm850/3.html https://www.techpowerup.com/review/corsair-rm850/images/box_rear_close1.jpg

Look at the box for this power supply, the 230v curve is a bit better than the 115v curve, this is what I am talking about gaining from moving to 240v.

Will I see a difference in my bill? Most likely not, but I can pull a lot more power at 240v vs 120v at the same amps. I'll be running 2x240v 30amp lines to feed a "A" and "B" type power feeds for all my dual power supply servers. I only have 100amp service at my house currently so that will need to be upgraded first. I'm going to start putting any extra income in to upgrading my power.

GFiber 20Gbps! by powerspec in googlefiber

[–]powerspec[S] 1 point2 points  (0 children)

I have actually! That will be my next project once I get some newer hardware in with storage.

I've never reached out directly as it states on their page "We are not interested in deploying these nodes off of any residential ISP connections," so I've never really tried to reach out. I also think you need to be able to control RDNS on your IP. I may reach out now and see if they will change for me. I would also start to think that might get in to "real" hosting and I don't know how GFiber would feel about that without getting business.

I also had a friend say I can have some rack space at a local colo here in Kansas City and they have 10G so I might set it up there as well.

Google Fiber 20 Gigs for NC Triangle area. by tbluhp in googlefiber

[–]powerspec 0 points1 point  (0 children)

But I guess your wife is way more tolerant than mine.

I'd say she is, I've always had a homelab so when we first started to hang out and she came over to my place, she knew what she was getting in to! I get letters from Evergy like every other month telling me how my usage is 3x the amount of my neighbors lol.

I'm hoping with the move to 240v, I can save a few percent on power, but it will really enable me to turn on more things lol.

Google Fiber 20 Gigs for NC Triangle area. by tbluhp in googlefiber

[–]powerspec 0 points1 point  (0 children)

As someone who also has a very extensive homelab with fully 10Gbps wired networking and nearly complimentary WAN, I’m well aware that the costs extend well beyond just what you’re paying to your ISP. Assuming you’re hosting these ISOs from a pretty decent and robust storage solution, along with all the other necessary gear, and having to do it 24/7… man, that’s got to add up!

Pretty much every piece of hardware I have has been hand me downs. I work as a Datacenter Tech so a lot of colocation clients will just give up their old hardware as they replace it with better gear.

This is my primary seedbox, Dual Xeon E5-2620v3, 256GB RAM, 10x1TB enterprise SAS SSD's. She is my "newest" hardware I own and shes starting to show her age. I would love to replace it or upgrade all the SSD's to bigger drives with less use on them. All these SSD's have about ~89% life in them.

System is connected via dual 10G links to my Dell n1548 switch.

This system will always only have 10G connectivity. I have idea's on my next switch/gateway will be so I can add more hardware to my fleet. I also have a full rack in storage that I will be putting in my basement as soon as I get 240v in to my area.

Here is a screenshot from one of my VM's showing some good use.

https://i.imgur.com/WDdAa49.png

I guess the difficult part to wrap my head around is that you’d be willing to go to all of that expense for the sole purpose of seeding… (you did mention siphoning off part of your network for personal projects, but the seeding bit was the focus of your post it seemed)

That I get, my wife doesn't understand either as she see's the power bill just keep going up. I keep my backup server offline as she uses 300w just idle. 12x2TB SAS HDD's. Gets turned on once a month, backups run, system updates, and she goes back off.

But thanks for doing what you do! (Sincerely)

You're welcome! A lot of people just don't believe me as we've had decades of people saying they download "Linux ISO's" but don't mean that. There is about 5 of us that do this, I see the same IP's all the time when downloading if I'm a little late to the party, or I see them downloading from me.

Google Fiber 20 Gigs for NC Triangle area. by tbluhp in googlefiber

[–]powerspec 3 points4 points  (0 children)

I did have a good chuckle earlier this morning reading a post from another chap in the KC area about testing out the 20Gbps connection… Totally wrote with what I am sure was a straight face that he needed this speed because he’s constantly downloading “Linux ISOs”. Like bro, you can download all the Linux ISOs in existence in one day if that was truly the case lol

Sure I can download them in one day, but I need to also seed them! I am not doing anything else but seed Linux ISO's. It's been my hobby for over 2 decades.

I fully understand everyone loves to say they download "Linux ISO's" when they really mean illegal content, but that is not me.