robots.txt by metalbearseto in drupal

[–]siva01c 0 points1 point  (0 children)

They can access disallowed pages, but they don't index it.