If this is your first visit, be sure to
check out the FAQ by clicking the
link above. You may have to register
before you can post: click the register link above to proceed. To start viewing messages,
select the forum that you want to visit from the selection below.
We aren't aware of a pre-prepared list for MediaWiki. But someone might have done it. It isn't that hard to make your own however.
The basic process is to index maybe 100 pages from your site. Then carefully examine the log to see what URLs have been indexed.
As you spot unwanted URLs, you decide if you want to exclude the entire directory or just that file. Then you add that file or directory to the skip list. e.g.
/UnwantedFile.asp
/unwantedDirectory/
In some cases you just want to exclude some actions of a script but not others. Then you need to include specific parameters in the skip list. e.g.
/Script.asp?action=PrintHardCopy
/Script.asp?action=Logout
You then repeat this process, index some files, check the log, exclude some files, until everything that needs to be excluded is excluded.
Make sure you save your configuration file to avoid repeating the exercise in the future.
Comment