Internal server error on indexing ??

[wingnut144]

I am trying to index my site, and all works well, except for 1 particular file that always says 'Could not download file: http://www.salleboise.com/contact.cfm (Internal server error)'

All other .cfm files are indexed fine, and I can view the page without any problems.

Any ideas??

[Ray]

There is a bug in your ColdFusion script on that page (contact.cfm).

It seems to only work when it can recognize a certain User-Agent string. It will fail, and return status 500 (Internal Server Error) if it fails to recognize the User-Agent.

FYI, Zoom identifies itself as "ZoomSpider - wrensoft.com". Your script only seems to be recognizing MSIE and possibly Mozilla (questionable for the latter, it seems to only recognize only very specific User-Agent strings).

Here were some tests using "wget" (which is a bare basic HTTP request allowing me to specify the User-Agent as a parameter).

It fails when I don't specify a User-Agent string:

C:\support\zoom\wingnut>wget [URL]http://www.salleboise.com/contact.cfm[/URL]
--12:04:05--  [URL]http://www.salleboise.com/contact.cfm[/URL]
           => `contact.cfm.9'
Resolving [URL="http://www.salleboise.com"]www.salleboise.com[/URL]... done.
Connecting to [URL="http://www.salleboise.com"]www.salleboise.com[/URL][71.36.27.209]:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
12:04:05 ERROR 500: Internal Server Error.

It fails when I specify a User-Agent string which it may not recognize (in this case, "Mozilla"):

C:\support\zoom\wingnut>wget --user-agent="Mozilla" [URL]http://www.salleboise.com/contact.cfm[/URL]
--12:05:34--  [URL]http://www.salleboise.com/contact.cfm[/URL]
           => `contact.cfm.10'
Resolving [URL="http://www.salleboise.com"]www.salleboise.com[/URL]... done.
Connecting to [URL="http://www.salleboise.com"]www.salleboise.com[/URL][71.36.27.209]:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
12:05:35 ERROR 500: Internal Server Error.

It succeeds when I specify "MSIE 6.0" or "MSIE 7.0":

C:\support\zoom\wingnut> wget --user-agent="MSIE 7.0" [URL]http://www.salleboise.com/contact.cfm[/URL]
--12:01:42--  [URL]http://www.salleboise.com/contact.cfm[/URL]
           => `contact.cfm.8'
Resolving [URL="http://www.salleboise.com"]www.salleboise.com[/URL]... done.
Connecting to [URL="http://www.salleboise.com"]www.salleboise.com[/URL][71.36.27.209]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
    [    <=>                              ] 17,327        18.04K/s
12:01:43 (18.04 KB/s) - `contact.cfm.8' saved [17327]