Hosting Customer Forums

Full Version: Stopping the spiders!
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hi

A generic question perhaps. But does anyone know how to stop the search engines stop spiders accessing certain parts of a website, i.e. something that's private, say a members only area (nothing dodgy promise!!)?

I have thought of password protected directories..?

Thanks v. much!
Hi,
This can be done with an .htaccess file or use the robots meta tag.

If you Google either of these it should give you an idea.
Reference URL's