Glancing through the logs for this site, I notice that a huge number of hits have a useragent "msnbot/0.11 (+http://search.msn.com/msnbot.htm)"
I don't really have anything against msnbot -- I just am starting to think maybe they are checking a bit too much.
I've been logging apache into a database with Apache::DBILogger, which is quite awesome (on a side note, why doesn't it log the method? I should add that.)
A quick SQL query or two turned up these things:
mysql> select count(*) from requests where remoteip not like '192.168.192.%'; +----------+ | count(*) | +----------+ | 2183 | +----------+ 1 row in set (0.01 sec)
mysql> select count(*) from requests where useragent like 'msnbot%'; +----------+ | count(*) | +----------+ | 451 | +----------+ 1 row in set (0.01 sec)
20.65% of my hits from the outside world (ie, not from my internal network) are from MSNbot.
I mean really. Maybe it is just time to set robots.txt to disallow it.
Of course, that would probably make me lonely.
Oh, this stylesheet looks terrible with this... time to fix that. Also, 7 more hits in the time it took to write this. Make that 8.

so, yea?