Does anyone have any ideas about how I might index a site that serves ads on its pages. Obviously I don't wish to index the ads, just the main content. I have to use the spider option as I don't have access to an offline copy of the content.
The pages all have a similar structure so maybe what I am looking for is some sort of command to skip parts of the pages.
The pages all have a similar structure so maybe what I am looking for is some sort of command to skip parts of the pages.
Comment