I am trying to index a site with a number of pdf files in it, but somewhere along the line, the pdfs cause the indexer to die.
Even when I use the debugging mode and look at the log file, I can't figure out what is going on.
I have been adding more and more pdfs to the list of files to skip, but the indexer is taking a while to run and I need a quicker solution.
Here is a listing of the last lines before the latest crash:
Queued URL: http://www.si-instruments.com/files/catalog/Download Centre/KSM/Operating Manuals/kistler_staiger_mohilo_supply_and_evaluation_instr ument_umv_2000_4700_manual.pdf
Skipping http://www.fnuky.com.au/ (External site - does not match base URL)
DL Thread #2, got URL (http://www.si-instruments.com/files/catalog/Download Centre/DCI/Product Brochures/dci_vcc_1010_leak_detection_system.pdf) off queue
Downloading file http://www.si-instruments.com/files/catalog/Download Centre/DCI/Product Brochures/dci_vcc_1010_leak_detection_system.pdf
DL Thread #2, got URL (http://www.si-instruments.com/files/catalog/Download Centre/KSM/Operating Manuals/kistler_staiger_mohilo_assembly_monitoring_system_ dmfp_v3_manual.pdf) off queue
Downloading file http://www.si-instruments.com/files/catalog/Download Centre/KSM/Operating Manuals/kistler_staiger_mohilo_assembly_monitoring_system_ dmfp_v3_manual.pdf
Even when I use the debugging mode and look at the log file, I can't figure out what is going on.
I have been adding more and more pdfs to the list of files to skip, but the indexer is taking a while to run and I need a quicker solution.
Here is a listing of the last lines before the latest crash:
Queued URL: http://www.si-instruments.com/files/catalog/Download Centre/KSM/Operating Manuals/kistler_staiger_mohilo_supply_and_evaluation_instr ument_umv_2000_4700_manual.pdf
Skipping http://www.fnuky.com.au/ (External site - does not match base URL)
DL Thread #2, got URL (http://www.si-instruments.com/files/catalog/Download Centre/DCI/Product Brochures/dci_vcc_1010_leak_detection_system.pdf) off queue
Downloading file http://www.si-instruments.com/files/catalog/Download Centre/DCI/Product Brochures/dci_vcc_1010_leak_detection_system.pdf
DL Thread #2, got URL (http://www.si-instruments.com/files/catalog/Download Centre/KSM/Operating Manuals/kistler_staiger_mohilo_assembly_monitoring_system_ dmfp_v3_manual.pdf) off queue
Downloading file http://www.si-instruments.com/files/catalog/Download Centre/KSM/Operating Manuals/kistler_staiger_mohilo_assembly_monitoring_system_ dmfp_v3_manual.pdf
Comment