index page shows twice in results...

[ShorePatrol]

This isn't a huge deal, but just wondering if there is a solution...many of my folders use "index.asp" as the default page, and the results for a search show this page twice, once with the folder/ and once with the folder/index.asp even though it's the same page...would be nice if it only showed this page once in the search results...



Thanks!

[Ray]

Under "Configure"->"Scan options" turn on the "Duplicate page detection" feature ("Use CRC to skip files with identical content").

This is necessary because, technically, the two different URLs can be two different pages. The response of these URLs depend on server configuration. So another server could be configured to return different pages for these URLs.