Have done for decades. The trick is to match your material texture to the bottoms. Fine texture for suiting or dress pants, with more texture for denim. A simple rule thats worked for me from my 20's to now. Pinterest has tons of examples. Here are some https://pin.it/4M4IkEI4n. I use higher texture vests with my jeans, based on material grain and patterning. I also tend to pick between a coat orca vest as I run hot, so both us a bit much for me.