How in spider mode to index all files in a folder?

[pebraham]

Hi,

We have a folder on our web site into which various contributors put documents (usually PDFs) at random times.

Without manually checking these folders for updates, is there a way I can get spider mode to index these files?

I tried the obvious way of putting a wild card in the 'start spider from this url' field but that doesn't work.

(We need to use spider mode.)

Thanks,
Pete

[David]

Do you have a HTML page that links to all these PDF files? As pointing to the indexer to this page should solve the problem.

Do you keep an offline copy of the files (e.g. a backup). As offline mode indexing might also be an option.

Do you have Apache / IIS automatic directory listings turned on? If you did then pointing the indexer to folder should solve the problem.

If none of the above options make sense for your site, can you install a directory listing script on your site and point the indexer to that script?

Scheduling might also be of interest to you.
http://www.wrensoft.com/zoom/support/scheduling.html
(as might incremental indexing)