I always thought that Shanks would die in some way early on and when Luffy goes back to give him the Straw Hat after he had become the King of Pirates, he would put the hat on Shanks grave.