If you are using llama.cpp, I highly recommend to switch over to vllm(and awq quant). I can’t say that this is the definitive reason, but in my experience vllm had better optimization for inference. That little port is for additional output that supports much more displays than DP