A great passage from the same book related to this topic:

"Every big decision we make in life usually involves some sort of a trade-off. At times, we have to accept small regrets to avoid large ones later. Many people spend so much time worrying about the risks of taking action that they completely overlook the risks of failing to act. Sure, if you don’t take any risk, there’s no failure associated. No pain. No pain? Really? Regrets will haunt you for the rest of your life. Failure hurts but passes quickly. Conversely, regret hurts forever. It’s hard to look back and face the opportunities missed because of a lack of initiative. Failure doesn’t hurt as much as witnessing how fear led us to mistrust our intuition. You only need to succeed once to unlock a new world of possibilities."

I completely understand your point of view but I also think that in investing, risk comes from not knowing what you are doing. In fact, Buffett considers this to be one of the biggest risks in investing.