PassMark Logo
Home » Forum

Announcement

Collapse
No announcement yet.

Site no longering indexing correctly

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Site no longering indexing correctly

    Hi,

    I've been using Zoom on www.recruiting.forces.ca for a while now, and since today, I have not been able to index the site. I get no errors, it simply no longer follows any links.

    The indexing starts from this page : http://www.recruiting.forces.ca/v3/default.aspx

    The site uses flash, so I have hidden html links (view source, scroll to bottom of file). I have the links to the french and english home pages there. Those pages are also Flash, so I have each menu link hidden at the bottom of that file too. But for some reason, Zoom doesn't pick them up anymore.

    I'm using the CGI/Win32 platform for indexing. Here is my log file when I try to index the site. I would appreciate any help you could provide, since this is a relatively urgent matter (we get about 20000 hits per day on this site, so users will notice that my search page is down). Thanks a million.

    Code:
    09:58:37 - Start indexing (spider mode) at Mon Oct 23 09:58:37 2006
    09:58:37 - Maximum number of words: 50000
    09:58:37 - Maximum number of files: 5000
    09:58:37 - Will scan files with extensions
    09:58:37 -      .htm
    09:58:37 -      .html
    09:58:37 -      .txt
    09:58:37 -      .php
    09:58:37 -      .asp
    09:58:37 -      .cgi
    09:58:37 -      .aspx
    09:58:37 -      .pl
    09:58:37 -      .php3
    09:58:37 -      .pdf
    09:58:37 -      .xls
    09:58:37 -      .ppt
    09:58:37 -      .doc
    09:58:37 -      .swf
    09:58:37 - Spider from: http://www.recruiting.forces.ca/v3/default.aspx
    09:58:37 - Web site URL: http://www.recruiting.forces.ca/v3/
    09:58:37 - Estimated RAM required during index process: 129981 KB
    09:58:37 - Initiating HTTP session (thread #1) ...
    09:58:37 - [DOWNLOAD] Downloading file http://www.recruiting.forces.ca/v3/default.aspx  (6385 bytes)
    09:58:37 - [SCANNED] Scanning http://www.recruiting.forces.ca/v3/default.aspx
    09:58:37 - Initiating HTTP session (thread #2) ...
    09:58:37 - [FILEIO] Writing index data for CGI/Win32 search... (Please wait)
    09:58:37 - [FILEIO] Created dictionary data file (zoom_dictionary.zdat)
    09:58:37 - [FILEIO] Created wordmap data file (zoom_wordmap.zdat)
    09:58:37 - [FILEIO] Created pagetext data file (zoom_pagetext.zdat)
    09:58:37 - [FILEIO] Created pages data file (zoom_pages.zdat)
    09:58:37 - [FILEIO] Created titles data file (zoom_titles.zdat)
    09:58:37 - [FILEIO] Created descriptions data file (zoom_descriptions.zdat)
    09:58:37 - [FILEIO] Created dates data file (zoom_datetime.zdat)
    09:58:37 - [FILEIO] Created spelling data file (zoom_spelling.zdat)
    09:58:37 - [FILEIO] Created script settings file (settings.zdat)
    09:58:37 - Indexing completed at Mon Oct 23 09:58:37 2006
    09:58:37 - INDEX SUMMARY
    09:58:37 - Files scanned: 1
    09:58:37 - Files skipped: 4
    09:58:37 - Unique words found: 62
    09:58:37 - Total words found: 1
    09:58:37 - Avg. unique words per page: 62
    09:58:37 - Avg. words per page: 1
    09:58:37 - Errors: 0
    09:58:37 - URLs visited by spider: 1
    09:58:37 - URLs in spider queue: 0
    09:58:37 - Total bytes scanned/downloaded: 6385
    09:58:37 - File extensions: 
    09:58:37 -     .htm scanned: 0
    09:58:37 -     .html scanned: 0
    09:58:37 -     .txt scanned: 0
    09:58:37 -     .php scanned: 0
    09:58:37 -     .asp scanned: 0
    09:58:37 -     .cgi scanned: 0
    09:58:37 -     .aspx scanned: 1
    09:58:37 -     .pl scanned: 0
    09:58:37 -     .php3 scanned: 0
    09:58:37 -     .pdf scanned: 0
    09:58:37 -     .xls scanned: 0
    09:58:37 -     .ppt scanned: 0
    09:58:37 -     .doc scanned: 0
    09:58:37 -     .swf scanned: 0
    09:58:37 -     No extensions scanned: 0
    09:58:37 - Cleaning up memory used for index data... please wait.
    09:58:37 - Finished cleaning up memory.

    Cynthia

  • #2
    I finally found the solution to my problem. I turned on the verbose and realized that my base url was different in my links. Correcting this solved my problem.

    Comment

    Working...
    X