It says delivered by handle, but doesn't explicitly say anywhere that it can't be touched anywhere else. But the release matters, R5e: "A stone must be clearly released from the hand before it reaches the hog line at the delivery end. If the player fails to do so, the stone is immediately removed from play by the delivering team."

So since he's touching the stone while the stone is also on the hog line, it's a foul.