PassMark Logo
Home » Forum

Announcement

Collapse
No announcement yet.

Follow Internal and limited external links?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Follow Internal and limited external links?

    Hi, on our site we have attachments hosted on another domain from the main site that gets indexed. I would like to search the main site and these attachments but not search any other external web sites that may be linked to from the main site. Is this possible?

    Thanks

  • #2
    Yes. You can specify multiple base URLs for a single spider URL.

    So a spider URL of:
    http://www.mysite.com/index.html

    With a base URL of:
    http://www.mysite.com/;http://www.myothersite.com

    Will ask the spider to start crawling from mysite.com/index.html, and follow all links that go to either the "mysite.com" domain or the "myothersite.com" domain only.

    There are more possibilities using the multiple start points available. See chapter 2.1.3 and chapter 2.1.5 in the Zoom Users Guide for more information.
    --Ray
    Wrensoft Web Software
    Sydney, Australia
    Zoom Search Engine

    Comment

    Working...
    X