PassMark Logo
Home » Forum

Crawl ignores stop and start tags

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • jmueller0823
    Junior Member
    • Mar 2010
    • 8

    #1

    Crawl ignores stop and start tags

    Love your product!

    We're doing some fine tuning and discovered that some of our "omitted" sections are still being crawled.

    Examining the view source, the tags do exist.

    Is there a "cache" we need to clear?
    Or?

    Thanks.
  • Ray
    Administrator
    • Dec 2004
    • 4357

    #2
    You can ask Zoom to not use the cache for spidering under "Configure"->"Spider options" and checking the option for "Reload all files (do not use cache)".

    What tags are you using to instruct Zoom to exclude the pages? I presume you mean robots meta tags and "noindex"? Make sure you have "Enable robots.txt support" checked on the abovementioned panel as well for this.

    You can also omit pages by the various options under "Configure"->"Skip options".
    --Ray
    Wrensoft Web Software
    Sydney, Australia
    Zoom Search Engine

    Comment

    • jmueller0823
      Junior Member
      • Mar 2010
      • 8

      #3
      Thanks for the response.

      We are using Zoom tags:
      <!--ZOOMSTOP-->
      <!--ZOOMRESTART-->

      Yes, "Reload all files (do not use cache)" is checked.

      Here's an example:

      1) Go to our site at: growth trac.com

      2) Search on the word "wickham"

      3) Click on the 2nd result:
      http://www.growth trac.com/artman/publish/audio-adrenaline-867.php

      4) Do a ViewSource and note that all of the "wickham" references
      are enclosed by the stop and restart tags.

      (Many) other pages have the same issue.
      We've double-checked and tried different tag positions, but to no avail.

      Thanks for the assist.
      Jim

      Comment

      • David
        Administrator
        • Dec 2004
        • 4714

        #4
        Here is the FAQ on using ZOOMSTOP and ZOOMRESTART.
        http://www.wrensoft.com/zoom/support....html#zoomstop

        As noted in the FAQ, "You can put <!--ZOOMSTOP--> and <!--ZOOMRESTART--> tags to mark the sections of your page which you do not want to be indexed. Note that both tags must be present as a pair for this to work"

        I had a look at the source code on your page, this is what you have,

        <!--ZOOMSTOP-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        So you don't have matching pairs.

        Comment

        • jmueller0823
          Junior Member
          • Mar 2010
          • 8

          #5
          Yep. Sorry to bother you with this. It must have been a late night.

          Comment

          Working...