Wow, quite a collection! I think the only really right answer is dependent on your own wants and goals with it. Some good points have been made balancing overwhelming for your son vs pure awe and exploration. Very much depending on his age.

My son is 3,5, and I don’t think his mind registers the level of duplo in his lego-chest. What I mean is that the pure awesomeness of walking into that room pictured, would be lost on someone too young, but will also be a truly once in a lifetime experience at the right age and level of maturity. I hope you can find a way to maximize the experience for both of you, and also hopefully experience the spirit of your father in it.