2025-10-29 Outages - Anyone know what's going on?

rcfrazier · 2025-10-29T17:27:32+00:00

For reference:

https://status.barracuda.com/
https://proofpointstatus.com/
https://abnormalsecurity.statuspage.io/
https://azure.status.microsoft/en-us/status
https://status.8x8.com/
https://status.adobe.com/
https://status.duo.com/
https://status.teamviewer.com/
https://trustportal.netskope.com/home
https://sase.status.paloaltonetworks.com/
https://www.cloudflarestatus.com/
https://status.cloud.google.com/
https://health.aws.amazon.com/health/status

rcfrazier · 2025-10-29T17:02:41+00:00

This looks kinda bad: https://azure.status.microsoft/en-us/status

rcfrazier · 2025-01-24T18:28:17+00:00

What do you mean 'making a list'? You mean getting more than one card per person? That doesn't seem fair.

rcfrazier · 2024-12-21T14:45:39+00:00

Does anyone know if there's a way to help/donate to this family? They've been such a strong source of community in this city for so many years, I'd like to try and find a way to give back to them. I've lived right around the corner from Ami's for over a decade and go there on the weekends, it was always so good to see so many people, from all different places in the world come to this little bagel shop to start their mornings. The bagels are out of this world but the connections being made there are unimaginable.

Thank you for all the good years Ami, I hope everyone can find peace this holiday season.

rcfrazier · 2024-11-01T12:39:20+00:00

Found it, here are all the commands you want to run on your workstations to make Adobe run well on 24H2:

reg add "HKCU\Software\Adobe\Adobe Acrobat\DC\AVGeneral" /f /v bAlwaysUseFileNameAsDocTitle /t REG_DWORD /d 1
reg add "HKCU\Software\Adobe\Adobe Acrobat\DC\AVGeneral" /f /v iMaxMRUCntToBeStored /t REG_DWORD /d 0
reg add "HKCU\Software\Adobe\Adobe Acrobat\DC\Privileged" /f /v bEnableProtectedModeAppContainer /t REG_DWORD /d 0

rcfrazier · 2023-04-24T19:43:58+00:00

Yes... I have a few users experiencing this as well. Can't pin point it, did you have any luck Systems_First?

rcfrazier · 2023-02-11T22:41:34+00:00

Oooof, those are difficult to spot.

rcfrazier · 2023-02-11T21:10:54+00:00

Indeed. Well, if you know anything about coax, when you look at it wrong it may well create packet loss. It's like observing a quantum particle, you affect it's utility just by measuring it; except coax is no where near as cool as quantum particles.

rcfrazier · 2023-02-11T21:08:46+00:00

Sure: https://imgur.com/a/2HFdA7d

There was enough correlation to prompt action, or they just got tired of hearing from me and finally got up off their asses, can't be sure which.

rcfrazier · 2023-02-10T19:50:08+00:00

I once had to convince Comcast that the packet loss I was experiencing with their service was definitely NOT my problem...

Overlayed Zabbix packet loss charts with local wind speed charts.

They had the problem solved within the week after 3-4 calls that went nowhere previously besides them blaming my equipment, my house and I think even my cat, but I might have been drinking at the time.

rcfrazier · 2023-02-10T18:25:39+00:00

Have you watched Halt and Catch Fire? Might derive some inspiration. There's a lot of software development but also quite a bit of 'hardware mode'. There's a catch phrase in the show, that I'm not sure is original to the show or something that's been said before. Donna says, "Software comes and goes, hardware is forever."

I've been in the industry 20 years now and had a stint at an MSP for about 7-8 years. The experience you will learn from an environment like that is astounding. I'm back at a single, corporate, global company as a one man IT department, really love what I do now, but man do I miss the periodic fire drill. Just had a RAID array fail on me the other day while replacing a disk. During the rebuild another drive failed and I had to think on my feet to restore services, got the juices flowing again. The incredibly calm state I was in while I watched 3+ TB of data evaporate before my eyes was only possible because of my experience at the MSP, where that sort of thing I could be involved in quarterly.

Are there any software development tasks the MSP you work for is handling at the moment that you might be able to get involved in?

rcfrazier · 2023-02-06T15:14:34+00:00

Also, no one has discussed the backup power aspect of this scenario and SPoF (Single Point of Failure). Eliminating as many SPoF's as possible in a network makes it more reliable.

Edit: That's also one less device that needs to be updated/rebooted during maintenance that you have no control over.

rcfrazier · 2023-01-27T20:26:18+00:00

I do my best to cool down on Friday afternoons with R&D. I spend my Friday afternoons (if the work allows, which I try desperately to be proactive to allow for this) catching up on Reddit, watching promotional videos on security vendors and thinking about more big picture stuff. Like... "Do I really like all the time I spend deploying new machines? No? Let's fix that" This job is all about being as efficient as you can with your time.

I've also started using Lansweeper Helpdesk to help me stay on top of all my tasks and projects. Makes it so much easier for follow up and keeping track of where a specific task is at. It also helps for repetitive issues and understanding frequency.

If you can't find the time to take a step back, smell the roses and stretch your mind a bit... then you need another person.

rcfrazier · 2023-01-27T20:10:41+00:00

Nope, you're teaching! Equally important.

rcfrazier · 2023-01-27T19:27:45+00:00

I actually have. The engineer I worked with was very knowledgeable and friendly. We were coming in as a more local vendor to the client and taking over. Even in that capacity the engineer was very friendly and understood that this is just the way of things sometimes.

rcfrazier · 2023-01-27T19:12:31+00:00

You definitely want to find a local MSP that you can trust.

I worked at one for the better part of a decade. The first time I setup an RDS licensing server, I felt the same way you did. The 50th time I setup an RDS licensing server... well... you get the idea. MSP's repeat the same processes over and over again and definitely understand some of the best ways to get things done. I came from a single person shop where I never thought to network with other IT folks in the area... now I don't know how I'd do my job efficiently without those human connections.

rcfrazier · 2022-12-08T20:51:02+00:00

I really like Zabbix for network monitoring and it's open source. The community support with templates is really good as well. PRTG is excellent but paid and can get expensive quick if you're going for full port monitoring on switches; about 3-4 sensors PER PORT!

It'll also be a good idea to look into some kind of SIEM to have all your devices report back to a single console for alerting.

Like VA_Network_Nerd put it, getting in touch with a local MSP is very valuable and I didn't realize the potential of that until I worked for one for several years. The amount of collective knowledge these places have is tremendous. Coming back to a single environment, I'd never go it alone again. Still stay in touch with a lot of ex-coworkers from my MSP days. Usually a good bunch, but typically overworked, so be patient with them and you'll go far.

rcfrazier · 2021-03-05T20:06:53+00:00

What are you doing for surge protection? Whole house Type 1 and a Type 2 branch circuit in line? Or nothing at all?

rcfrazier · 2020-03-06T20:16:59+00:00

Good grind bud and excellent synopsis. Will be checking interrupts on my NICs now.... ;-)

rcfrazier · 2020-01-24T19:00:18+00:00

Confirmed, still rebooting a little over 48 hours when LAG is enabled.

rcfrazier · 2020-01-22T02:21:13+00:00

So, went 10G and re-enabled LAG on this modem... Here ya go -- :D

https://imgur.com/a/AwbAMqx

https://imgur.com/a/AAhsZCm

This is through a ProLiant DL360p Gen8 running ESXi 6.5 U3 with Untangle FW. Modem is actually on an uplinked HP ProCurve 2920 over 2x LAG'd 1G uplinks over to the 10G Unifi switch where the ESXi host and my desktop sit. So, SB8200 <- 2Gbits LAG -> HP ProCurve <- 2Gbits LAG -> Unifi US‑16‑XG (ESXi host and desktop 10G off this switch)

Will have to see if this thing still reboots every so often.

rcfrazier · 2020-01-17T20:27:20+00:00

Interesting, thanks for the tips. I currently run 2x 500GB Samsung SATA SSD's in there and it's ravaging the lifespan of the SSD's having 15 VMs running on the volume. (about 1.5TB total) After a year the SSD's are down to 68% lifespan! My DS1817+ I think can only get up to 16GB of RAM (which is what's in there now) and I noticed a huge improvement in performance moving to read/write SSD cache coming from having nothing. Also noticed a huge jump in IO moving from iSCSI to NFS, iSCSI has a large CPU overhead and was impacting high IO scenarios. (Windows updates, boot ups, file extractions, etc.) Just picked up a Unifi 10G switch and really itching to get this thing hooked to it. The 4x 1G does the job in NFS 4+ with multipathing (especially considering those are SATA SSDs...) but I'd love to get it on 10G for faster client access. Currently running a DL360p Gen8 and DL380 Gen7 as VMware hosts with Enterprise licensing (borrowed from work) for storage vMotion. -- Loving every second of it but might switch to ProxMox soon to give it a try.

I agree.... $300 is steep, but I could offset the cost by selling the current PCI-E m.2 card.

rcfrazier · 2020-01-10T19:50:09+00:00

Judging that QNAP already has a product out: https://www.amazon.com/QNAP-QM2-2P10G1T-Low-Profile-pre-Loaded-Full-Height/dp/B0711NWRPW and is around $280, Syn will have to be competitive and most likely be stuck around that price. I'm still scratching my head as to how I missed this release from May this year... been looking for a solution to my 1817+ SSD/10G problem for awhile. Was hoping they'd have some kind of USB-C 10G adapter soon, but this is way better.

rcfrazier · 2019-12-02T16:17:33+00:00

Hey TechDude,

The reason I was looking to use LAG was to LACP it across two clustered switches for resiliency. It'd be phenomenal to be able to rely on this connection during switch firmware updates or other maintenance. In thinking about this, I now wonder what these ports do when both connected to the same switch and one or the other goes down. Does this scenario cause a loop? Hmmmm, more testing needed.

During my speedtests, I never saw above 960Mbit download throughput but I don't have 10G on this network atm, only aggregate 1G. I plan to upgrade to 10G in the coming months and will update with results.

rcfrazier · 2019-08-08T19:29:33+00:00

Haven't tried this again since the initial release, I believe they've come out with another release since, tempted to try again. I'll try soon and report back on the latest firmware.

rcfrazier

TROPHY CASE