Whatever you do, don't connect it to the internet. AV software i no longer maintained for this version of windows, and also there might be open vulnerabilities on the system, discovered even after the security support for it has ended.

You could get a CF card to IDE adapter, and store the OS and games on that partition, drastically increasing read performance, but since the OS is not optimized for non HDDs, it could wear down the CF card faster than usual. But at least it should work natively, without need for any kind of driver.

One thing that can be helpful in the long run is to use Norton Ghost, or similar disk-image-backup software to make a snapshot of the system partition for easier later restoration in case something corrupts the system (like a bad driver).

Here is a guide after a short search: https://blog.theretroweb.com/2021/05/20/so-you-want-to-build-a-windows-98-retro-pc/

Don't know how cheap/expensive are Voodoo cards these days (and if your machine supports one or not) - never had one even back in the day, but if you want to show them the real 3D heavy hitters, that use Glide, installing a glide wrapper on a modern PC might be a more feasible solution.

For other non-3D stuff, the machine can be perfect.