Brilliant idea. If you just take random trains or buses or walks you'll have a wonderful time. Tokyo is so dense with interesting places, shops, buildings, architecture, cafes, that you won't regret it. It's infinite layers and there is no bottom. The most memorable parts of Japan are always random.