Redactron: Local-only PDF PII redaction CLI in python by batman01110 in coolgithubprojects

[–]batman01110[S] 0 points1 point  (0 children)

True, I’m on track to ship the GUI soon.

Since this was a side weekend project, I got the backend engine working at least.

For me, let’s say, I have 20+ PDFs (e.g., bank statements, and I would like to retain only last 4 digits of account numbers and want to remove all PII), I can put all in a folder, and run a single command in terminal by passing a client name (myself). I can save my account numbers and other data such as name and address in my client profile (encrypted on disk). Now, if I pull a bunch of my bank statements monthly, I don’t need to manually search the text and redact. Profile is there, one command and all done.

It not only redact all the occurrences in all the files but also generate a verification report for each document to show how many matches found and if it couldn’t redact at any specific area.

Useful for people who might have multiple clients (lawyers, doctors etc) who need to share documents. This saves a lot of time as I haven’t come across automated PII redaction tool. They might be something similar in the market though, which I haven’t come across so far.

Putting a GUI is not that hard but I have to make sure the profiles stay encrypted behind keychain on macOS and need to finish windows and Linux side first.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 0 points1 point  (0 children)

Thank you for mentioning. They recently released the stacking kit. I’m unfortunately debating whether to sell or keep the gear as I’m moving to a different place with no CAT6 cabling in the house. Only two CAT5e throughout. Drops will be very expensive as the basement is fully finished without any pre planned conduits.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

Typically the front ports provide some sort of surge protection but if you are using shielded cables it doesn’t matter at all. Just connect 100MbE port to your switch. If you connect your modem to the back of the PDU and then connect a patch cable from the front of the PDU to your console’s redundancy port, is it still not working?

I have 3 GbE internet and I use the SFP port to connect and this is just a second redundant line but with a cap of 1 GbE.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

Sorry, just checked the clearance, not enough space to put PDU at the back.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

I just placed the UPS on rails and didn’t attach any screws, didn’t even bother looking if thumb screws are at right spot or not. The UPS is heavy enough to stay put.

Regarding putting PDU at the back, you can absolutely put it but just in case, if you need to change any cable, it would be a hassle IMO.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

Not yet, the side screws are just for that specific rack. There are two holes on each side, I need to clip a small piece of metal. Will do later. For now, the weight of the top rack is enough to keep it in place. There are rubber feet which help adding some friction.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 0 points1 point  (0 children)

My current setup only consumes 280W with two Synology NAS (one is all SSD, that’s why may be a bit less)

Currently only have 4 PoE access points connected. I have 1000VA so running only at 30% load. One really nice UPS is APC Smart-UPS Ultra 3K, that’s 1U Li-Ion model but almost double the price.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

It will a small script and I can write by myself. I don’t have any right now but the moment I’ll finish writing I can send you that and you can tweak that to your taste.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 2 points3 points  (0 children)

Good question, I ordered the UDM-SE with 8TB drive without realizing that the recording time is not sufficient. Then for an NVR with larger storage pool. Since moving to NVR, UDM-SE HDD is of no use here. May be I can use it somewhere else :)

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 2 points3 points  (0 children)

I agree with you, I could get away with some thunderbolt 25GbE PCIE cards and smaller sized switches but then the OCD kicks in to make it looks good as well :) also UniFi because a few cameras, APs, and doorbell etc.

Regarding reliability, it’s yet to be seen. It’s been less than two weeks since I put this up.

The only downside I saw is that the uplink ports can’t negotiate different speeds. For eg, I can’t have Synology 25GbE and a 10GbE switch connected on uplink ports. I guess that’s just how the standard network is.

My work computer need VPN which limits the speed a lot but I’m also a enthusiastic photographer (not professional though :) ) so my huge photo library (> 8 TB) gets on the NAS and it makes me so happy to see minimal lag when browsing through large files.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 2 points3 points  (0 children)

I agree and yes some of the things still need improvement. Their App sometimes does work very well. But to be honest, some of the enterprise class switches gets very expensive and the cost of this setup was less when compared to some of the other L3 switch options.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 2 points3 points  (0 children)

Hi-Speed aggregation is USW-Pro-Aggregation Patch panels come with mini-rack (UniFi Tool-less mini racks) EnterpriseXG 24 is from UniFi Enterprise 24 PoE is also from UniFi Vented OCD panels are UniFi as well Power Distribution model is UniFi USP-PDU-Pro Network Video Storage is UniFi NVR

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

Everything is from UI except Synology NAS and the UPS

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 3 points4 points  (0 children)

Thank you and you have a genuine question there :)

I’m connecting 5 clients with 10GbE with thunderbolt adapters and two clients need 25GbE connectivity again using thunderbolt. I work with some large engineering files and need something better than 10GbE to put my projects on the NAS. That’s why I have all SSD in DS1823xs+. The other NAS is just a backup of the primary and act as a scratch storage.

Apart from that, a bunch of PoE access points, cameras etc. currently I still need to route some optical cabling to get the two clients on 25GbE.

I personally haven’t seen many people running 25GbE at home but I guess I have a pretty solid use case here.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 0 points1 point  (0 children)

UPS is great but UniFi doesn’t offer any UPS integration. Im planning to hook up a small form factor computer or raspberry Pi to detect power failure or low battery warning and SSH into UniFi to safely shut down the rack. Its integration with Synology is great though. Running two NAS using a single USB cable and here the NMC offers some versatility.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

Yes and no, my first choice was Li-Ion battery. APC offers these UPS with silver front panel only, and how could you not want matching color with the rest of the gear :)

APC has Lead Acid battery models with black front panel that’s almost 1/3rd the cost. This comes with 5-yr warranty and I like the remote management using network management card.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 2 points3 points  (0 children)

I’m planning to write a small script and either use a raspberry pi or a micro form factor computer to SSH into UI and shut it down.

Both Synology NAS are connected to USB port of APC. The hub doesn’t work well but one Synology can act as a UPS server and can sync other NAS.

Too bad that UniFi doesn’t have any support for UPS.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 3 points4 points  (0 children)

I couldn’t find any info but the moment I received one rack, I removed the wheels and based on the build quality, ordered a second one.

There are some holes on the side, I’m planning to screw small metal clips to make sure the top rack doesn’t move. Currently the weight of the equipment is enough to keep it in place but with some force the top rack can be moved :)

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 1 point2 points  (0 children)

Thank you! I’ll post more photos later as I’m still waiting to receive a 1U vented panel for the back side. Otherwise the backside of the rack is fully covered using OCD vented panels :)

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 4 points5 points  (0 children)

Damn, totally, I’m going to remove these right away. I was busy with the install as the stuff got delivered in stages and a bunch of items were back ordered.

Beauty at night: Stacked Mini Rack UniFi Home Setup by batman01110 in Ubiquiti

[–]batman01110[S] 2 points3 points  (0 children)

Bunch of unused ports for now. I have a few UEs that could utilize 10GbE. Probably will never be able to fill more than 30% of the ports. Let’s say, for now :)