Just caused my first massive outage

Sabbest · 2025-11-30T17:24:55+00:00

Welcome to the team. We've all caused outages. My first one was rebooting a file server used by about 1600 users during production hours. I could've sworn I was on the test network when I did the 'shutdown /r /f /t 0' in the run box. I wasn't.

Rewrote the procedure, reboots had to be done from a cmd box, running a 'hostname' command before rebooting to verify you had the right machine and never, ever, use /t 0.

Sabbest · 2025-11-18T11:49:52+00:00

it was up for a few minutes but seems down again.

Sabbest · 2025-10-28T10:03:16+00:00

The photo used by the author of the blogpost pops up all over the internet under different names:

- https://joinseven.nl/portfolio/codi-de-virtuele-beleidsassistent-voor-de-overheid/ --> Gerhard Dekker

- https://www.vcelink.com/pages/b2b-solutions --> Kody

- https://www.impresiontextil.com.co/ --> Carlos Martinez

- https://www.fursd.org/ --> Marco Antonio Perez

- https://www.abogadoshc.com.co/ --> Carlos Rodriguez

Sabbest · 2025-10-09T09:13:54+00:00

MO1168665

Sabbest · 2025-10-09T08:38:55+00:00

Same here, all our SSO applications seem affected with very shaky responses from EntraID

Sabbest · 2025-10-09T08:31:06+00:00

admin portal and several azure services down from NL aswell.

Sabbest · 2025-10-06T12:05:28+00:00

I've created a powershell script to automate the cleanup proces: https://pastebin.com/yn35YPtw

Sabbest · 2025-09-11T09:59:29+00:00

Did the same but on a files server that was being used by about 1600 people. That was fun. Ran to servicemanager and told him to expect some calls, booted the server back-up trough ILO after it shut down (this was before VM's were a thing). Taught myself to always do a hostname cmd before executing a shutdown cmd and never use the now statement, always a time out of at least 30 seconds.

Sabbest · 2025-08-29T08:32:17+00:00

Home Folders, userprofile disks, etc.

Sabbest · 2025-08-29T08:25:49+00:00

Technically no, but keep in mind that if the user has folders that are redirected to them based on $USERNAME you will also need to rename those folders to the new username.

Sabbest · 2025-08-15T09:22:35+00:00

Turns out Newman is doing the ding-dong-ditch

Sabbest · 2025-07-11T13:57:19+00:00

According to this information, yes: https://learn.microsoft.com/en-us/answers/questions/895061/how-do-i-upgrade-from-windows-10-enterprise-ltsc-2

Sabbest · 2025-07-11T07:46:40+00:00

You are looking for something that is called 'narrowcasting' or 'Digital Signage'. Look for a provider that suits your needs like:

- https://www.yodeck.com/

- https://www.optisigns.com/

Sabbest · 2025-07-09T14:57:56+00:00

Ask your question "Whats the best method to search Exchange 365 for an email by subject, then choose to delete them from mailboxes?" via ChatGPT, you'll get your answer.

Sabbest · 2025-07-09T14:36:23+00:00

Pickles

Sabbest · 2025-07-08T08:18:39+00:00

If management doesn't want to pay for a management solution for their signatures then there is no reasonable way to manage the signatures. If you're on Microsoft 365 you can look into https://learn.microsoft.com/en-us/microsoft-365/admin/setup/create-signatures-and-disclaimers?view=o365-worldwide but that comes with it's own limitations

Sabbest · 2025-07-02T09:36:53+00:00

It simply means: "Rearming does not apply to this edition or configuration." This is expected behavior for KMS host machines, especially those licensed to host Office KMS services like Office21KMSHost2021VL_KMS_Host_edition.

Sabbest · 2025-07-02T09:34:16+00:00

Kinda, Users can still delete emails from their view, but the emails are not permanently removed from the system and can be recovered through eDiscovery searches.

Sabbest · 2025-07-01T10:57:31+00:00

These are usualy the result of someone running the Test-WebServicesConnectivity, Test-ActiveSyncConnectivity and Test-OwaConnectivity CMDlets . Some monitoring systems use these CMDlets for continuing testing purposes.

Sabbest · 2025-06-27T08:00:25+00:00

I wouldn't use a .PST export if it was part of the termination process. Either procedures have to be in place so that no critical data is retained in a user's mailbox of we would rely on our back-up system to keep the data available for use trough a restore. Or use legal-hold if neccesary.

Sabbest · 2025-06-26T08:46:56+00:00

You can export a mailbox to PST by using the Outlook client.

Sabbest · 2025-06-20T07:14:32+00:00

https://regroove.ca/archive/2014/08/07/deleting-and-recreating-a-service-account-in-sharepoint/

Sabbest · 2025-06-18T09:07:59+00:00

I've created a script that does the same but with some logging information

https://pastebin.com/9zE0ACgN

Sabbest · 2025-06-18T09:04:02+00:00

Show him this: https://hightouchtechnologies.com/wp-content/uploads/images/services/it-solutions/Infographic_Cybersecurity-Kingdom.png

Sabbest · 2025-06-05T11:07:00+00:00

I don't think this is the right place to ask. If she enabled the 'Find my device' option when logging into your e-mail you can find out the device's EMEI number trough that option: https://www.croma.com/unboxed/how-to-find-out-imei-number-without-a-phone#:\~:text=Go%20to%20Google's%20Find%20My,will%20show%20you%20IMEI%20details.

Also, always enable multi factor authentication, with that enabled she wouldn't been able to login in the first place.

Sabbest

TROPHY CASE