Offline and spider modes giving vastly different results

[Richard Davis]

Hi, I just downloaded V5.1.1016 and tried to re-index my site but got unexpected results in the spider mode.

When I index the offline folder of my site, I get the results I expect with all the jpg files indexed but when I use the spider mode from my home page, it doesn't appear to be crawling all the levels so misses all the jpgs I want indexed.

Although I can upload the offline index, which is fine as the site is static, I can't generate the site maps in the offline mode.

I can't find any obvious difference in the configurations but maybe I'm missing something in the spider mode configuration?

Regards,
Richard.

[Ray]

You should take a look at this FAQ:
Q. I am indexing with spider mode but it is not finding all the pages on my web site

Your pages are most likely not linking to the files in a manner that a spider can crawl/follow them.

Also, there shouldn't be any reason why you can't generate sitemaps in offline mode. Just make sure you have your Sitemap base URL set to match your indexing base URL.