Subj : ftp-html.js
To : All
From : Dreamer
Date : Fri Jun 17 2011 11:20 pm
I got to watching Googlebot on my logs tonight, and mulling it over while we've
been discussing it, and just wondering why it would hammer the FTP so bad.
Seems like a waste of resources on their part.
Then I noticed the 00index.html?$gnsiuo0i filenames. I noticed it changes
every time, and I figure, maybe this is throwing Google off. You would think
they would be smart enough to ignore anything after "?", but perhaps they made
a mistake and haven't bothered to fix it, or it's just buggy for FTP
connections and they can't be bothered to look at it. I don't know.
Anyhow, looking at the code, I noticed that it's just a timestamp to kill
browser caching. Has anyone tried removing the timestamp, and seeing if it
affects Googlebot at all?
Just in case, I went ahead and removed the timestamps (backing up my original,
of course), and I'm waiting a while for Googlebot's cache to roll over. It's
been about an hour, and it's still using the old timestamped links.
