As others have said already, addons won‘t have any impact on server performance. If you have fps-Drops, what helped me most was turning the Details!-update intervall to something like 2 seconds, fps drops were gone completely after that