PassMark Logo
Home » Forum

Announcement

Collapse
No announcement yet.

Subdomains Not Indexing

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Subdomains Not Indexing

    First, I just want to say how amazing Zoom Search is and that I have received many emails from users saying how much they love the search functionality of our website. We've been using it since October and have customized it quite a bit. Here is a sample search on our site.
    http://www.crimethinc.com/search/search.php?zoom_query=recipes+for+disaster&zoom_ca t%5B%5D=-1

    So, onto my question. We use a subdomain, thecloud.crimethinc.com, to host large PDF files at Amazon S3. These are linked to from pages in our main site, such as at http://www.crimethinc.com/blog/2008/04/09/from-the-archives-seattle-logistics-zine/

    The above page gets indexed, but the PDFs at thecloud.crimethinc.com do not. The only way I've been able to get them indexed is to list each one's specific URL in the additional start URLS section. But I know there has to be a better way. Any help would be greatly appreciated.

  • #2
    You can adjust the base URL to allow the following of links and indexing of sub domains.

    In spider mode, this the base URL automatically determined for you based on the URL of the start page specified, but you can override it if necessary (click on the “More” button and select “Edit”). When specifying your own base URL in spider mode, you can also list more than one base URL by separating each with a semicolon (‘;’). For example, to allow a spider to follow links from the start point “http://www.mysite.com/index.html”, to pages hosted under the “pages.mysite.com” domain, you would have to specify a base URL of “http://www.mysite.com/;http://pages.mysite.com/”.

    Comment


    • #3
      and voila!

      thanks to your info and the amazing power of the semi-colon, the problem is solved. thanks a million! I have another question, but i'll start a new thread, since it is entirely unrelated.

      Comment

      Working...
      X