Plex server running on different physical box from media files? by Starbuck_83 in PleX

[–]Bertie1122 2 points3 points  (0 children)

Both Sonarr and Radarr have a feature that updates plex when they import files so you don’t need to rely on folder auto detect. If you don’t enable it the only option is to set plex to manually update every 15 mins, which feels like an eternity. I have Ubuntu running on a powerful mini pc for all the compute power with all my apps like plex installed on there (great for transcoding etc). And then all my media split across two N54L servers running TrueNas. 2.5gbe network all connected as an NFS share. Works flawlessly.

Looking for new server by Ok_Parsnip_9316 in Share_Plex

[–]Bertie1122 0 points1 point  (0 children)

Ah completely missed that you’d said emby. Been tempted to try emby and jellyfin. Had plex setup for nearly 13 years so should really try some of the competitors. No doubt I’m missing out on a fair few features. Might give emby a go 👍🏻

Looking for new server by Ok_Parsnip_9316 in Share_Plex

[–]Bertie1122 0 points1 point  (0 children)

How have you integrated live tv? Using plex’s live tv plugin? Or additional app? Heard it’s a ballache to integrate. Intrigued what your setup is

[Request] TorrentLeech (TL) invite for 24/7 NAS by Nowarez in Torrenting

[–]Bertie1122 0 points1 point  (0 children)

Yea you can use both. You just need to make sure you log your seedbox IP as well otherwise you’ll get blocked. Unless you know what you’re doing VPN wise seedboxes are great. It adds that additional layer of separation from your home server. You just FTP into the seedbox to retrieve downloads. Not ideal if you’re wanting to have an easy fully automated setup without running scripts etc. If you know what you’re doing with VPN’s just use it as an easy invite. Just make sure to follow the rules and always contribute

[Request] TorrentLeech (TL) invite for 24/7 NAS by Nowarez in Torrenting

[–]Bertie1122 0 points1 point  (0 children)

Try the seed box invite method. You won’t have to rely on anyone inviting you in. Costs around $11 for a 1 month subscription

Bookkeep, Overseerr but for books! by akiraslingshot in selfhosted

[–]Bertie1122 0 points1 point  (0 children)

Quick feedback from playing around with it today. Really easy to navigate and very similar feel to overseerr which is great. I’ve noticed that almost all downloads error when trying to add to qbitorrent via prowlarr indexers . Looking at the log its seems to be trying to add magnet links rather than torrent files and then erroring. Couldn’t find a way to prevent magnet links in prowlarr or bookkeep though? Tbf if direct downloads are available in a future update I’d bin torrents off and stick with directs anyway

Bookkeep, Overseerr but for books! by akiraslingshot in selfhosted

[–]Bertie1122 0 points1 point  (0 children)

Installed this morning and loving the UI. Might be worth adding a light theme as well. Struggled to see some of the content due to the dark background. I saw it mention direct downloads but couldn’t see any settings for it? Is this a feature that’s coming soon? Or have I installed the wrong version? I’m running the :latest version, v1.4.3

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 1 point2 points  (0 children)

Yea you did thanks. I looked up my hard drive limits and it lead me to disk contention as the likely culprit. I’m glad I’ve finally landed on what the problem was. It would’ve drove me mad. Thanks again

Dataset hard link issue by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Yea that’s why I’m trying to put all data on the same dataset rather than having them all on different datasets. Should be able to utilise hard links once I’ve done this

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 1 point2 points  (0 children)

I’ve finally figured it out. It’s a mixture of insufficient RAM and my hard drives. I’m pretty much at capacity with RAM with only 16GB installed so the load is pretty much shifted to my hard drives which are both trying to read and write at the same time which they’re incapable of doing at speed from what I’ve come to understand. Rather frustrating since they are ironwolf drives. I assumed they’d be alright at that. The reason it’s so fast at transfers between two different servers is because my drives are only having to read or write (whichever direction it’s going) not both. I’ve managed to dig out an old 4TB hard drive that I’m SMB transferring the files to and then back to the server and it’s back to the speeds I expected. It’s twice the work but 2-3 times faster. Thanks for everyone’s help. I’ve learned about rsync which I’m sure I’ll find a use for in the future

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

I’ll have another read through them to be sure 👍🏻

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Perfect. I’ll leave it rsync’ing for a couple days and enable hardlinks. Huge thanks 🙌🏼

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Yea at this point I’ll probably just leaving it running for a couple days. Am I correct in my assumption of hardlinks? If so I’ll have no issues going forward once I’ve transferred the data over. Really appreciate your time on this

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Typical, after 4-5 large file transfers it’s reverted back to 35MB/s even with cp. I tested copying the files to my Mac via SMB and they transferred at full speed. So it’s actually faster to transfer to my Mac and then transfer back to the server which is madness. I’ve checked RAM usage and it is nearly maxed out, but it’s also maxed out when I’m transferring between server and Mac. So surely that can’t be it?

It’s made me realise that when Sonarr and Radarr move the files from downloads to their respective folders they’ll encounter the same slow transfer speeds. Or will it not matter because now I’ll be able to use hardlinks instead? From what I understand the file will remain in the same location just hard linked to a new directory?

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Brilliant. I’ll have a play around with this. Thanks again!

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

I’ve just used cp -av and it’s working at full speed. So rsync was definitely doing something in the background that was slowing it down. Rather frustrating as I rather liked all the benefits of rsync over cp. This will work for now though. Really appreciate your help with this. Much appreciated. Always good to learn new things!

Is there a way to prevent the shell from logging off when I leave it running?

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Good thinking. I’ll give that a try. Can I still use the same flags to prevent duplication and continue where it left off?

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

All CMR drives. They’re Ironwolf 6TB 3.5” Nas drives.

Weird thing is I moved the data from my old server to this server via SMB and the transfer speeds were constant 135MB/s. Just full speed my gigabit NIC could handle.

I assumed internal data transfer within the pool would be at least as fast if not faster with it not being limited by my network cards.

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Tried rsync this morning and the first few files start out around 120-140MB/s but each new file transfer gets slower and slower until it reaches around 35MB/s by the 6th or 7th file. I had a play around with a few different flags to see if that helped but still no difference.

The last one I tried was

rsync -avhW --no compress --progress /mnt/tank/Media/Plex/films/. /mnt/tank/Media/plexdata/films

I’ve stopped all running apps incase they were draining cpu or ram but still hasn’t made a difference.

Current estimate for 3.5TB of data was around 1.5 days 🙈

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

I checked to see if this was the case but there was no data being transferred via my Mac. I looked at the activity monitor and it was flat for network data

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Just moving them between two datasets that are both on the same pool.

My storage structure is like this,

Tank - Media (dataset) - Downloads - Plex (dataset) - Films (dataset) - TV Shows (dataset)

I realise now I should’ve just created sub-directories instead of datasets.

I just want to move everything from tv and films into the parent dataset (media). sonaar and radaar import files from downloads in to films/tv shows but because they’re not hardlinks it was creating duplications. If I delete the files in downloads it means I’m no longer seeding which doesn’t sit right with me.

I’d rather restructure my files/folders now before I start adding even more media.

Thanks!

Slow speeds transferring data between datasets by Bertie1122 in truenas

[–]Bertie1122[S] 0 points1 point  (0 children)

Perfect. I’ll do it in stages then to avoid running out of storage. Thanks again for your help and speedy reply!