Hi,
I am trying to index an external site (one I cannot add tags to) that is a list of job postings. Is there anyway to tell the indexer to not index the content of the main job listings pages - but still to follow the links on those pages and index the job pages found beyond those links? The main job listing pages (there are several of them) are overwhelming the results and hiding the useful job postings.
I tried the skip pages options, but that also means that the links on those pages aren't followed and the end result is an empty index.
I am trying to index an external site (one I cannot add tags to) that is a list of job postings. Is there anyway to tell the indexer to not index the content of the main job listings pages - but still to follow the links on those pages and index the job pages found beyond those links? The main job listing pages (there are several of them) are overwhelming the results and hiding the useful job postings.
I tried the skip pages options, but that also means that the links on those pages aren't followed and the end result is an empty index.
Comment