MSN Bot Loves Me

| | Comments (1)

Glancing through the logs for this site, I notice that a huge number of hits have a useragent "msnbot/0.11 (+http://search.msn.com/msnbot.htm)"

I don't really have anything against msnbot -- I just am starting to think maybe they are checking a bit too much.

I've been logging apache into a database with Apache::DBILogger, which is quite awesome (on a side note, why doesn't it log the method? I should add that.)

A quick SQL query or two turned up these things:

mysql> select count(*) from requests where remoteip not like '192.168.192.%';
+----------+
| count(*) |
+----------+
|     2183 |
+----------+
1 row in set (0.01 sec)
mysql> select count(*) from requests where useragent like 'msnbot%';
+----------+
| count(*) |
+----------+
|      451 |
+----------+
1 row in set (0.01 sec)

20.65% of my hits from the outside world (ie, not from my internal network) are from MSNbot.

I mean really. Maybe it is just time to set robots.txt to disallow it.
Of course, that would probably make me lonely.

Oh, this stylesheet looks terrible with this... time to fix that. Also, 7 more hits in the time it took to write this. Make that 8.

1 Comments

so, yea?

Leave a comment

About this Entry

This page contains a single entry by Christopher Pruden published on September 13, 2004 2:13 PM.

Assault Weapons Ban, Rest in Pieces was the previous entry in this blog.

Now with commenting goodness is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Powered by Movable Type 4.1