Oct 7, 2006

security-lab1.juniper.net abuse

python-urllib/1.16 security-lab1.juniper.net

The above bot fell into a bot trap. In order to do this it had to violate the rules in the robots.txt file. It is not clear why www.juniper.net is sending out a bot.

I have written to them and am waiting for a reply on what this thing is and why it was caught in a improper crawl.

In the mean time python-urllib/1.16 is added as a email harvestor since thats why I find about that useragent on other sites.

1 comment:

Erik said...

security-lab1.juniper.net is a Tor exit node, so it is likely someone was running their bot through Juniper's hidden service.