Google: November 2002 Archives
Maybe Google News does at least need a spot-check editor. No harm, no foul though. When you have something this complex that is completely automated, there are bound to be cases like this. At least this one was kind of funny.
So I was doing some re-org on the site, basically putting things in a nicer directory structure. So now the archives are in a YYYY/MM/DD format. I was getting tired of one directory full of files. Lots of files. I'm archive by month, day, and individual.
Anyway, this caused google to re-index the entire weblog.
$ grep -c googlebot /var/log/httpd/patandkat-access_log*
/var/log/httpd/patandkat-access_log:2464
/var/log/httpd/patandkat-access_log.1:706
/var/log/httpd/patandkat-access_log.2:470
/var/log/httpd/patandkat-access_log.3:1017
/var/log/httpd/patandkat-access_log.4:789
/var/log/httpd/patandkat-access_log.5:1020
