goes without saying you allow google,bing,yahoo
but what others do you allow and disallow
some examples that have visited one of my blogs in the last week not saying i would allow them all
larbin2.6.3@u
baiduspider
mj12bot
mlbot
tweetedtimes
paperlibot
catchbot
0.83
exabot
gigabot
ichiro
yandexbot
aghaven
twitmunin
pycurl
6.0b
jakarta
geourl
butterfly
sindice-fetcher
y!j-bsc
blogpulselive
birubot
wikiwix-bot-3.0
voyager
ia_archiver