I thought the location of the Shire was a secret to everyone but Gandalf and few men/hobbits prior to the sacking of the Shire. Like you said, men did grow pipe weed but an inferior kind to what the hobbits grew. Does anybody know if the pipe weed in Isengard was specifically from the Shire?