How can I control why indexing is not running any more?

[ifm_t]

We use the version 5.1 (Build 1016) for a bigger site with PHP script output.

Sometimes the indexing is not running anymore, for example a html file downloading (1019 bytes) and indexing, nothing more.

The problematic page was normally a frameset.

The last possibility is to stop indexing and to loose final data.

How can I control what the reasons are?

Possibly a server error, but we use a very slow method with 1 second delay and the problematic page is running with no problems in a browser.

Can anyone help?

[David]

To start with turn on debug logging in Zoom, on the index log tab in the Zoom configuration window. Then have a look at the last few messages to discover what is being done when indexing stops.

Certiainly if you are having server problems, then that isn't going to help.

After indexing stopped, how long do you wait? There should be a timeout after a few minutes if a server side error prevents the page from being downloaded.

Does it always stop on the same file, or is it random? If it is the same file, what is the URL to that file?

[ifm_t]

I will test the debugging mode.

I wait more then 10 minutes, but there is no time-out message. How long should I have to wait?

The stop is on different files, but in the same site area, always on so called data sheets.

[David]

Are "data sheets" Excel files or HTML file. If they are Excel files, you should also check that you have the latest plugin files.

I think the timeout is 3 min. So if there is not progress for 10min then there is some other issue.

If you want, you can send us your Zoom configuration flle and we can try indexing from here.

[ifm_t]

I got the same problem again, but I do not find any additional information regarding a debug mode; see attached last entries of log file:

...
10/02/08 09:18:13 - Downloading file http://www.ifm.com/ifmus/web/dsfs!KI5210.html
10/02/08 09:18:13 - Indexing http://www.ifm.com/ifmus/web/dsfs!KI5210.html
10/02/08 14:36:28 - Indexing paused. Waiting to be resumed...
10/02/08 14:36:36 - Stop indexing requested by user. Finishing up...
10/02/08 14:36:36 - All index files will be written to: C:\..\ZoomSearch\ifm_US
10/02/08 14:36:36 - Writing index data for PHP search... (Please wait)
10/02/08 14:36:36 - Created pagedata data file (zoom_pagedata.zdat)
10/02/08 14:36:36 - Created pagetext data file (zoom_pagetext.zdat)
10/02/08 14:36:36 - Created pageinfo data file (zoom_pageinfo.zdat)
10/02/08 14:36:36 - Created spelling data file (zoom_spelling.zdat)
10/02/08 14:36:36 - Deleting presaved index data...
10/02/08 14:36:36 - Deleting pageinfo data...
10/02/08 14:36:36 - Deleting miscellaneous buffers...
10/02/08 14:36:36 - Deleting URL history...
10/02/08 14:36:36 - Deleting duplicate page history...
10/02/08 14:36:36 - Writing out the dictionary...
10/02/08 14:36:36 - Created dictionary data file (zoom_dictionary.zdat)
10/02/08 14:36:36 - Created wordmap data file (zoom_wordmap.zdat)
10/02/08 14:36:37 - Created script settings file (settings.php)
10/02/08 14:36:37 - Partial indexing completed (stopped by user)
10/02/08 14:36:37 - INDEX SUMMARY
10/02/08 14:36:37 - Files indexed: 1055
10/02/08 14:36:37 - Files skipped: 30852
10/02/08 14:36:37 - Files filtered: 0
10/02/08 14:36:37 - Files downloaded: 1096
10/02/08 14:36:37 - Unique words found: 9688
10/02/08 14:36:37 - Total words found: 203065
10/02/08 14:36:37 - Avg. unique words per page: 9.18
10/02/08 14:36:37 - Avg. words per page: 192
10/02/08 14:36:37 - Start index time: 08:51:46 (2008/10/02)
10/02/08 14:36:37 - Elapsed index time: 05:44:51
10/02/08 14:36:37 - Errors: 11
10/02/08 14:36:37 - URLs visited by spider: 1107
10/02/08 14:36:37 - URLs in spider queue: 1138
10/02/08 14:36:37 - Total bytes scanned/downloaded: 8760986
10/02/08 14:36:37 - File extensions:
10/02/08 14:36:37 - .htm indexed: 251
10/02/08 14:36:37 - .html indexed: 804
10/02/08 14:36:37 - Cleaning up memory used for index data... please wait.
10/02/08 14:36:37 - Deleting wordmap data...
10/02/08 14:36:37 - Deleting presaved index data...
10/02/08 14:36:37 - Deleting pageinfo data...
10/02/08 14:36:37 - Deleting miscellaneous buffers...
10/02/08 14:36:37 - Deleting URL history...
10/02/08 14:36:37 - Deleting duplicate page history...
10/02/08 14:36:37 - Finished cleaning up memory.
10/02/08 14:36:37 - Created search template file: C:\..\ZoomSearch\ifm_US\search_template.html
10/02/08 14:36:37 - Created text sitemap file (urllist.txt)

What's now on?

[David]

There is a 5 hour gap in the log file.
10/02/08 09:18:13 - Indexing http://www.ifm.com/ifmus/web/dsfs!KI5210.html
10/02/08 14:36:28 - Indexing paused. Waiting to be resumed...

Is that becuase you edited the log file, or becuase it stopped on the file called, dsfs!KI5210.html and you didn't notice it for 5 hours, then after 5 hours you manually stopped it?

It would still be nice to get your Zoom configuration file (see my last post)

[ifm_t]

I will send you my config file.