Crawlers and Zoom database

[waynef]

Hi,

Is there any advantage at all to allowing the search engines to crawl the zoom search data files? I currently disallow *.zdat in robots.txt, but I'm wondering if I should continue to do that, and whether it would cause any harm if I allowed them.

Any opinions? Thanks.

Wayne

[David]

Normally a spider would not find the .ZDAT files becuase 1) you never create a link to these files so the spider would not find them and 2) They are not in a format that any other spider software would know about.

So there should be no need to block them in robots.txt.

--
David

[waynef]

Thanks, that's what I thought.

Wayne