PassMark Logo
Home » Forum

limit stopwords

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • helman
    Junior Member
    • Jun 2010
    • 4

    #1

    limit stopwords

    hi,
    the limitation on stopwords with 400 is too low.
    Lists with german or english stopwords typically have about 1.000 entries or more.
    What can i do to skip all the words i want to?

    Manfred
  • David
    Administrator
    • Dec 2004
    • 4714

    #2
    What is the reason you are using these long list of stop words. Maybe there is an alternative method to achieve the same result.

    We see a lot of people using the stop word list for the wrong reasons.

    Comment

    • helman
      Junior Member
      • Jun 2010
      • 4

      #3
      i do not want that the stopwords appear in search results.

      Comment

      • David
        Administrator
        • Dec 2004
        • 4714

        #4
        Using stopwords does not stop these words appearing in the results. If for example, the word in question appears in the page title, it will still be displayed regardless of if it is in the list or not.

        Comment

        • helman
          Junior Member
          • Jun 2010
          • 4

          #5
          ok. but for which purpose use these stopwords?

          Comment

          • Ray
            Administrator
            • Dec 2004
            • 4357

            #6
            Stopwords (aka skip words) are words which the Indexer will not store any index data for, and you will not be able to search for.

            For example, a common word like "the" would appear so often, that this would swamp the index data. The larger the index data, the longer it takes to search (and the more resource intensive the procedure). It also means bigger files to upload to your server.

            In addition, it would sway the results in an unhelpful manner: e.g. if you search for "the beatles" (without quotes), you don't want a page containing 100 instances of "the" (and maybe 5 instances of "beatles") to be considered more important than a page containing 10 instances of "beatles".

            So that is why you would want to "skip" them or exclude them from the indexing.

            However, you don't want these words to be suppressed from appearing in the search results, as most sentences would cease to make sense. Imagine a sentence with all the common words like "the", "and", "or" stripped out of it.

            If you actually want to exclude an entire page because a particular word appears on it, take a look at the Content Filtering feature (chapter 2.2.12 in the Zoom Users Guide)
            --Ray
            Wrensoft Web Software
            Sydney, Australia
            Zoom Search Engine

            Comment

            Working...