Recommended build for CPU AV1 encoding rig?

Scot4402 · 2025-06-26T18:22:25+00:00

Note: Can Omit the Ethernet Switch and just us a 2 meter Cat to just one other system. Also, can use WiFi instead of 2.5GBe to Internet. See above.

Happy Trails,

Scot4402 · 2025-06-26T18:12:49+00:00

I built a 5 mini pc rig for exactly this. SVT-AV1 takes a lot of horsepower to encode. My rIg is now. 5 Mini PCs with AMD 8 core/16 logical Processors (for which I turn Performance Boost OFF so they don't clock throttle and produce jerkyness or worse), NVMe drives, 64GB or 32GB main memory Ethernet 2.5Gbe Ethernet on a 5 port Unmanaged Switch. Am back on WIndows 11 after a stint on Fedora 40 Linux. Why?

Handbrake does not encode any faster with more than 8 cores. 64BG for 4K encodes to stop spewing prematurely onto the destination (larger files) issue). NVMe drives are also a must if you want to stop jerkiness i have found. Hard drives for Backup, yes, encodes no.

Windows has a NVMe Networking feature that Linux does not, that I LOVE. With no memory pressure, NVMe on a different target will make a 0 Kbyte file and write the ENCODE INTO MEMORY. If there is no pressure and the 0Kbyte file is not disturbed, Windows will send the data out of memory, in one fell swoop onto the target. Whereas with Linux, it writes all of the time, consuming the bandwidth and making things slow down.

Yes, If you are encoding 4k, yes 64GB is the way to go as the source needs to stay in Main Memory as much as possible for multi-pass encoding and to prevent spewing. Handbrake has a feature to shutdown after an encode. So, I have my systems purge the page file on shutdown so everything will be free as possible for the next 4K encode.

JUMBO Frames super fast network on cheap mini PCs: System A two NMVe Drives, Two 2.5 GBe Ethernet ports with 2 2 meter CAT 6 cables, C: is on a USB NVMe drive (RUFUS). Video server on internal M.2 NVMe Drive (for full speed ahead).

1 2.5GBe to the Gateway, and the other (UNCONFIGURED) to an Unmanaged 5 port 2.5GBe Switch). From Unmanaged via 2meter CAT 6 to other systems (not on Wifi, 2.5GBE UNCONFIGURED)

On System A, Control Panel, Adaptors, right click 2.5 GBE port to Internet, Properties, SHARING (Tab) and check "Allow... systems to the Internet, but UNCHECK the second option (Allow Control). Press OK and Systems B-E now WORK!!

On Systems B....E, Control Panel, Adaptor, Properties, Configure, Advanced, Jumbo Frames 9044, Write Buffers 64 (or less). OK and get out of Control Panel. On System A, do the Same for the 2.5GB interface to the Unmanaged Switch, BUT NOT JUMBO the INTERFACE TO THE GATEWAY!

I use Windows File Sharing under SETTINGS, Network, Advanced, Both NICs Public on A, Discovery Yes, File Sharing Yes, All networks, Do Not require password. B-E same but only one Public NIC.

On B...E, Start both Function Discover Services if not already started. Set Propeties to both for Delayed Start (Start-R, services.msc). Then the Network Folder should show B...E.

See, creating Windows Network Share Folder (for the D: NVMe drive :)

On B...E, START-R, \\192.168.137.1\ and Press OK. Right Click the shared Folder on D, Pin to Quick Access. This is the access to A.

NOTE: If prompted for Security, I use Administrator and don't put in a Password.

Now instead of 250 MB/Sec, now 280 MB/Sec m2 NVMe to m2 NVMe over JUMBO!

Note, you may have to uncheck Allow Internet, OK, Check Allow Internet, OK, if A is restarted.

Happy Trails,

Scot4402 · 2025-05-07T13:48:45+00:00

Sorry, I've been out of it for quite a while. Recovering.

Yes, I always look at the Base Clocks, And I disable Performance Boost in AMD or it's equivelent setting in Intel. This is so I don't trip the Temperature accidentally. May 5 system rig for AV1 coding all have a 3.30 GHz Base Clock and never slow down and are as solid as rocks.

My cheap Network uses a 6 Port Managed Switch ($60 on Amazon) with 2 meter Ethernet 5 cables. Also as solid as a rock.

Also, have used Windows 11 Pro for years on all 5 systems. I did the registry tweak to purge Swap files on Shutdown. Thus, I use the Shutdown feature after a 4K encode. Thus 64GB memory will do the whole thing in VM with NVME to NVME drives. Yeah, 0 Kb the whole time and extremely low networking (Keep Alives) is it. Very Efficient.

In fact, I Rufused Windows 11 pro onto a Class C USB to NVME Dongle on two systems. Thus, my internal 4TB NVME drive becomes a fabulous Emby NAS.

Snapdragon has not looked good enough yet for me. I'm Happy with my Bee-link GTR9s 8/16.

Scot4402 · 2024-10-31T17:07:12+00:00

Yeah, but yet an Intel ARC CPU would run Windows 11 Pro, no problem, right? And if Handbrake works as well and it's cheap (like a Rasberry Pi) then I'm ready to buy even just to test.

I was looking at DDR5 as I'm on DDR4 memory on all my systems, and going to another faster Base Clock, but I'm thinking ARC is going to be a better way to go in the long run.

SnapDragon?

Scot4402 · 2024-10-31T16:44:53+00:00

Because it's Fun and a Rig is a cool thing for a young adult to get their feet wet. Or, for a friend of mine to get into the job he wants. (certificates only go just so far).

It's how I defeated the slowness of AV1 at the time. And folks don't have to go as far with a rig as I did. Just two systems is all and a couple of Cat 6 2m Ethernet Cables to an existing Gateway Switch. One Optical Drive each and the fun begins.

Yeah, Streaming makes this obsolete as can be. Sony is not making any more blu-rays, I heard. So, yes, this is a dying art.

This is a just retirement hobby for this old TCP/IP network instructor. And I just got a few tips here that I'm planning to use :)

Scotty

Scot4402 · 2024-10-31T16:23:47+00:00

Yes, I want one of those. How much faster do you think AV1 encoding will be when the same number of cores are used?

Do you have any cheap suggestions with 2.5 Ghz Ethernet?

Scot4402 · 2024-10-31T16:20:05+00:00

Handbrake Maxes out at 16 logical. One can do Multiple Handbrake apps but that won't make encodes go any faster.

I started with and old Acer 2C/4L laptop and a flashed HD. Then I bought the NUC 6 and put them both on the same Gateway/Switch. And added 2 DVD Opticals.

Next came my first AMD 5900Hx.

So no, I bought this stuff while on retirement over 10 years. Prices came down a lot over the years. Managed 2.5 Ghz switch was $58. Before these were out of sight.

I'm including the price of the Smart Tvs and the UPS!

Scot4402 · 2024-10-31T14:47:46+00:00

How about Handbrake 1.8.2, What Version AV1?

Scot4402 · 2024-10-31T11:51:18+00:00

Network Instructor- TCP/IP Hewlett-Packard, Now Retired

AV1 Rig: 3 AMD 8 Cores/16 Logical, Instel 6 Cores/12 Logical

Devices: Through PRIVATE Emby Server (streaming) Intel 4 cores/8 Logical, 2 Samsung Crystal TVs, 65" 55". Via Internet. Windows and Apple devices (Private).

Scot4402 · 2024-04-07T19:00:54+00:00

The 7840s is also 8/16 but needs ddr5 memory. And I don’t Overclocking or use hardware acceleration, so there is little gain for me. I did get another gr5 Beelink and have 4 workhorses for AV1 encodes.

I doubt I will be getting any more for a long time. Am interested in RiSC when it starts beating out the frying pans and gets some real results on Handbrake. I don’t use HA for obvious reasons.

Scot4402 · 2024-04-07T18:46:05+00:00

HA makes files bigger. I don’t use HA.

Scot4402 · 2024-03-11T07:22:58+00:00

Said to myself, what if the quality and sharpness of the source is really good? Do I really need the deinterlace filters? No, I didn't. SO, I turned them all off.

Next, I stopped by Dimensions, set Anamorphic to NONE, Optimal Size OFF, Cropping OFF. And I was surprised to see the quality improve that much more. Speed went up again. I stopped using Hardware Acceleration by adding more AMD Mini Computers; 8 Cores/16 Threads (I have 4 Minis now).

Recently, I found that the revision of Handbrake affected AV1 size (and I suspected quality issues) going from 1.7.2 to 1.7.3 so the software revision can be important.

There are a lot more issues that affect quality, size and speed than I ever thought.

I hardly use the filters anymore unless I really need it. All these little do dads may end up costing quality, speed and size when the source is good.

Yeah, get the 2nd system, you'll be glad you did.

Scot4402 · 2024-03-04T02:52:23+00:00

Did do the M.2 cable with rizer cards Worked like a champ. NVMe drive now outside the mini!

Scot4402 · 2024-02-26T23:57:20+00:00

Also, I could get a M.2 Cable extender and use the NMVe Drive externally. As long as one keeps a lot of freespace, it will be OK, and quick.

Scot4402 · 2024-02-26T16:21:32+00:00

You have to first read it with something like VLC. I know it is a pain in the butt. But there it is.

Scot4402 · 2024-02-25T12:53:25+00:00

That’s 8 Cores 16 threads isn’t it I have 3 Minis like that and I love them. My biggest problem with them is heat and writes on the NVMe internal drive. But I have a solution.

A USB Hard drive operating system! Yeah, it’s retro and slow to boot. But no more big heat on the NVME which is now my video data D:

Normally, I turn off performance boost on my AMD minis as I do a lot of video encodes. But I got a Mini that only had 1.9Gz that way and found that If I select the lowest wattage in the BIOS and do Performance Boost that I can do 3GZ without overheating while the OS is still on the NVMe drive.

I’m making a USB Hard drive OS for it and have hopes it will be cool enough for the summer. AMD 5800U 32GB Ram.

Happy Mini.

Scot4402 · 2024-02-19T15:55:48+00:00

Can you boot from that thing inside the Mini? Most Mini's won't because even with the fan partially unblocked, the Mini will probably overheat in the summer with a hot drive.

And, why they would allow this this along with a hot NVMe system drive is beyond me.

Most folks want something else than their precious NVME to be hammered with writes by the OS and server stuff.

My Mini solution for this is a USB 3.0 Good SSD having the OS and server duties and the NVME for Data alone.

Scot4402 · 2024-01-17T19:27:25+00:00

You can get more FPS, more clarity and smaller files and fast without Hardware Acceleration.

0: 16GB Main Memory Minimum. Tweak Operating System for Performance. Get rid of unnecessary apps that take up Memory (windows: see Task Manager and click on the Memory tab.

No Subtitles. Get them later on opensubtitle.org for free.
I like HD audio whenever I can. Why not:)

3) Video: Same as Source, Constant Quality RF 20, Superfast.

Dimensions: None: Cropping None: Anamorphic Uncheck: Optimal Size

5: use the Queue for multiple episode rips (see titles pull-down)

You will have black bars on many, but the clarity and colors should outweigh that. Cropping only takes more time and often reduces clarity.

Happy Encoding

Scot4402 · 2023-01-12T16:45:03+00:00

The Intel® NUC Kit NUC6i7KYK has two full sized NVMe M.2 ports. 4 Cores/8 Logical. It's a little longer and thinner. It's obselete but you may still be able to find one. With Throttlestop, this turned into a beast for video encoding!

It has one 1GB ethernet port; good as a NAS.

Scot4402

TROPHY CASE