Dan Feather Keeping spiders from media folders [WAS: Re: Creating Massive Site]
Jun 25, 2008; 09:26
Dan Feather
Keeping spiders from media folders [WAS: Re: Creating Massive Site]
John brings up something I was recently wondering about. I could use a refresher course in:
* how to prevent spidering (and, thus, indexing too, right?) of specific folders . . .
* why and when this (above) is good to do . . .
* how to actually prohibit web users to load pages (and other resources) from a specific directory WHILE ALLOWING OTHER PAGES on my site to ACCESS RESOURCES IN THE SAME DIRECTORY.
TIA!
- Dan
on 2008/06/24 8:43 AM, John Williscroft at design@icatching.co.uk was reported to have written:
> Also make sure that Google doesn't spider your image and video > folders, else you'll see massive traffic spikes when it tries ;-)
--
Dan M Feather Nashville, TN dan@danfeather.com
-- This list is a free service of LassoSoft: http://www.LassoSoft.com/ Search the list archives: http://www.ListSearch.com/Dreamweaver/Browse/ Manage your subscription: http://www.ListSearch.com/Dreamweaver/
Search
Lasso Programming
This site manages and broadcasts several email lists pertaining to Lasso Programming and technologies related and used by Lasso developers. Sign up today!