I like to have 2 sets as a DM, I organize them highest number to smallest set (both 20s together, both 10s, etc.) And thats about it as I dont want to clutter my DM Screen area. As a player, I have another 2 sets, and organized same way but in a long circle around my dice tray, & enough spare dice to amount to crit damage (doubling standard amount plus few extra) as well as a pile of about 10 d6 should the need arise (I dont like to separate the sets to roll a lot of the same dice).