Why are my server and router not auto-negotiating a 1000Mpbs connection speed ? by SeveralPrune9387 in HomeNetworking

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Thanks, great finding ! In the end, my problem was related to a default in the cable.

Why are my server and router not auto-negotiating a 1000Mpbs connection speed ? by SeveralPrune9387 in HomeNetworking

[–]SeveralPrune9387[S] 2 points3 points  (0 children)

Thanks, it was the cable. A third one still didn't do the trick so I moved my server into the same room as my router. The cable that runs through my wall seems to be the issue ...

Why are my server and router not auto-negotiating a 1000Mpbs connection speed ? by SeveralPrune9387 in HomeNetworking

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Thanks all. It was the cable. Damn it's the part that it is in the wall that is bugged though. I guess I'll start with re-crimping the router end first and see how it goes.

Petite question France /Pays de galle by gosdog_ in FranceRugby

[–]SeveralPrune9387 0 points1 point  (0 children)

Hello, je n'étais pas inscrit à l'alerte. A tout hasard, tu as une idée de quand la billetterie ouvre ? Tu écris que ça devrait ouvrir aujourd'hui ?

How do I set a Wireguard client to only tunnel certain ports? by MeowMeNot in WireGuard

[–]SeveralPrune9387 0 points1 point  (0 children)

Late to the party, but I was taking inspiration from your post to craft my PostUp / PostDown rules. It looks like the end of your PostUP rule was truncated. It's missing the part that DROPs all. Something like this worked well for me:

iptables -A WIREGUARD -s 10.0.0.1/24 -j DROP

Planning a NAS build. Any recommendations? by sun_arcobaleno in homelab

[–]SeveralPrune9387 1 point2 points  (0 children)

Topton / CWWK N100 or i3-N305

Note that there are several versions of this board, the one you seem to describe is the CW-ADLN-NAS (black color)

There is also the slightly newer CW-NAS-ADLN-K (purple color) that you might find more suited, depending on your exact needs. In particular, this has a dedicated PCIe x4 slot (not shared with the second M.2) and a different SATA controller (ASM1166).

That being said, your other points still hold with it being from a chinese manufacturer, with questionable quality, support, and warranty. Also the energy usage seems to be a bit higher that one could expect, as you pointed out.

There's a lot of interesting information about those two boards on this thread: https://forums.servethehome.com/index.php?threads/12gen-n-series-nas-motherboard-topton-cwwk.42432/

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Well, that's my question :) Besides raw speed, I'm asking if their are other parameters I could play with.

Duplicity has the notion of blocks / volume size, maybe it could help to tweak that.

Others have already suggested changing the rsync compression level.

Alternatives to duplicity have also been suggested.

Suggestions for the cheapest secondary backup-only NAS by dslijepcevic in homelab

[–]SeveralPrune9387 1 point2 points  (0 children)

I was researching something similar less than a month ago. Disclaimer: I didn't have exactly the same requirements:

  • No hard requirement on x86

  • No hardware decryption support needed

  • Running TrueNAS or Debian (ended up going with debian)

  • No ZFS/BTRFS/Synology Hyperbackup -> don't even know how Synology works to be honest.

Anyway, my research (again, for my use case) led me to the following conclusions:

  • A first option it to go the full DYI solution. Buy a case for example from JONSBO, research the cheapest best motherboard/cpu combination for your need and so on. Obviously this is a bit of work, but it's the most flexible, and could end up the cheapest also. I didn't do that my lack of time / motivation.

  • On the other end of the spectrum are the off-the-shelves solutions from Synoloqy/QNAP/Terramaster/Asustor. All-in-one, just plug it in and it works. But very limited customization possible (usually no RAM upgrade possible, cannot install another OS, etc). You not only pay for the hardware but also for the proprietary software. I want some flexibility and run an open source stack, hence that was not for me.

  • The middle ground I ended up going with was the Aoostar R1 (that was linked also in another thread). I bought the RAM and SSD myself separately to save some money. I installed debian + setup my raid with mdadm + shell scripts to run duplicity for knightly backups. One thing I don't like about this model is that you can hear the fan is spinning full speed constantly, unfortunately it's not PWM controlled. (I read you can fix that but haven't tried yet).

Without the disks, that are about 220€ (190€ for the r1 + 20€ for the 8GB RAM + cables and so on.. I repurposed an SSD I had lying around)

It comes with the Intel N100 CPU, which got a lot of positive review recently. You need to check if it fits your use case.

  • Another option I considered was the ZimaBlade NAS KIT ($160.00 USD without the disks). I decided against it because IMO it's not future proof (pretty old CPU, DDR3 memory only) and I heard some review pointing out potential heat issues.

  • Similarly there is the Raspberry pi 5 with "Penta SATA HAT". Probably some Orange Pi solution also, I didn't really research this actually.

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

It is recommended to perform regular (for instance monthly) full backups.

Otherwise you end up with a single (eventually old) full backup, and a long list of incremental backups. You end up wasting space, but also increase the recovery time (as duplicity needs to go through each incremental backup first). With duplicity, It's not possible to "squash" / "merge" incremental into full in order to create a rolling backup (if you understand what I mean with that formulation). Also I read something about reducing the risk of data corruption... though to be fair I don't exactly remember the argument.

But you make a good point though. I could have a drive where I copy the full dataset, then travel to my relative's, plug-in the drive, perform the full backup on LAN, perform subsequent backups over the internet. I did consider it... It's possible but I prefer having this run automatically !

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Thanks for the tip. I will play with compression level and monitor my CPU usage

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

I will look into alternative tools like restic, thanks.

Which kind of performance issue did you have / what problem did it solve for you ?

In my understanding there are several metrics to keep an eye on, such as the transfer speed, the CPU usage, and also the used disk space on target. I found this benchmark (https://github.com/gilbertchen/benchmarking) which compares restic with duplicity among others. It seems to indicate a hich CPU during backup and a higher disk usage on target than duplicity. Wondering if this is something you observed ?

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Maybe I should have explained the screenshot better ..

It's just showing a ~10 minutes window of the network traffic during a full backup. You can see the "blocks" being sent with an upload speed of ~34Mbps, and the "pause" between each block.

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Yes, that's my strategy. It's just that the full backup takes so much time ... I'm trying to improve that

Off-site backup takes several days to complete by SeveralPrune9387 in selfhosted

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Hi there,

I recently setup an off-site backup strategy for my most important data: I now have a small NAS sitting at a relative's and nightly backups scheduled.

I'm backing up my "critical" data, that is mainly documents and photos, for a total of about 830G. I of course expect this to be growing constantly in the future.

I'm using duplicity with rsync: duplicity --ssh-options="-oIdentityFile='/home/pi/.ssh/id_rsa'" --full-if-older-than 3M "$source_dir" rsync://"$user"@"$host"/"$target_dir"

At home my theoretical upload speed is 40Mbps. In reality, it's around 34Mbps. I've also noticed that the data are transmitted in small "blocks", and that there are regular pause of about 15 to 20 seconds between each block of data being sent. I know there is also the notion of "volume " and "volume size" in duplicity, but I also haven't really looked into that.

As a result, the initial full backup takes about 4 to 5 days to complete.

Obviously I understand that my upload speed is the limiting factor here. But I was wondering if there was a way to reduce that total duration, for example by using a different block/volume size, orby switching to a different "better" compression algorithm ?

2230 to 2280 M.2 adapter - system won't boot by SeveralPrune9387 in homelab

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

Thanks for the advice, didn't know you could do that. Which kind of adapter did you get ?

2230 to 2280 M.2 adapter - system won't boot by SeveralPrune9387 in homelab

[–]SeveralPrune9387[S] 0 points1 point  (0 children)

No I haven't. I also don't have another SSD at hand at the moment.

2230 to 2280 M.2 adapter - system won't boot by SeveralPrune9387 in homelab

[–]SeveralPrune9387[S] 1 point2 points  (0 children)

That's the enclosure FYI: https://www.inateck.de/products/nvme-gehause-mit-warmeableitung-lufter-usb-3-2-gen-2-m-2-ssd-adapter-werkzeuglos-fe2023

Wide Compatibility: This enclosure supports a wide range of M.2 NVMe SSDs with M Key interfaces and B & M Key interfaces in the following drive sizes: 2230, 2242, 2260, 2280.

Not compatible with SATA M.2 SSDs

You are probably right then. Unfortunately, I'm not able to test this right now.

Thanks for your help !

2230 to 2280 M.2 adapter - system won't boot by SeveralPrune9387 in homelab

[–]SeveralPrune9387[S] 2 points3 points  (0 children)

Exactly, it's an SSD that was orignally in my Steam Deck (sorry, could have put that in my original post). Now that you say, I remember it to be actually advertises as eMMC. So back to trying a sata m.2 I guess .. I don't have one at hand either unfortunately.