I am using a SMF forum to among other things protect a documents area of the forum. I am able to spider the documents with direct URLs, but I lose the protection of the authentication system of the forum because the links generated by the search script are direct and bypass the forum. Is there another way to get the script to see for example a .pdf file at a link similar to: "http://www.mysite.org/smf/index.php?action=dlattach;topic=14.0;attach=9" The spider does not follow links like this and recognize if it points to a .pdf.
Thanks,
Rich
Thanks,
Rich
Comment