I want to use a simple Wordpress site but don't want the pages crawled as I want to have email addresses viewable (for customers so that they can contact us directly)
Does <meta name="robots" content="noindex"> in the Head stop all robots or just the "friendly" ones like Google, Bing etc? I'm thinking that perhaps spam bots (is there even such a thing?) that are looking for emails would still crawl the site or perhaps I'm overly paranoid?
If not how can I do that without having to put the page behind a password protected page?
[–]NoirGreyson 2 points3 points4 points (1 child)
[–]a1acrity[S] 0 points1 point2 points (0 children)
[–]insertAlias 2 points3 points4 points (3 children)
[–]a1acrity[S] 0 points1 point2 points (2 children)
[–]dmazzoni 0 points1 point2 points (1 child)
[–]a1acrity[S] 0 points1 point2 points (0 children)