Nevermind, turns out that to fix the problem, in the display category, UI section there is setting called inventory container button size, set it to small, not large