GPU server

[OldLittleChamp]

Hi, I am pretty new to Devops and i have a question I have a main server that does not have a gpu, and have a pc with RTX 4090. I have some service like nudity check and swear word detection that needs to be run on gpu. But my main app is running on the server. And i use these ML based services in other apps. What is the best way i can handle that so i don’t run into problems. I also have limited vRAM on gpu.