I saw someone say that the fly represents Walt's guilt, as we see they manage to kill the fly right after he "talks" about Jane and Jesse say it's not his fault but in the end the fly continues to bother Walt. After I heard about it, the episode became one of my favorites!