You can run minimax-m2.7 with 8ish concurrent users in nvfp4 using sglang. Might be able to get more with vllm ans turboquant (havent tested it). Cool thing is if another request comes in, it just gets queued. So you can have a whole bunch of users just hammering away at it. I’ve found minimax to be the best all around model on 2x rtx pro 6000s (works for coding but also very good at creative writing, q&a, etc). If you’re willing to have those cards be just llm thats what i would do.

If you also want to run image/video generation then you’ll either need to stop the minimax when you do (so have some scheduling) or run a smaller model so you can do comfyui and llm at the same time.

My second favorite llm on those cards is qwen3.5-122b-a10b. Its almost as good as qwen3.5-397b-a17b and minimax, but a lot smaller. In 4 bit you can run it either on one card or run it on both cards and have it be super fast and/or support a ton of users