python-urllib/1.16
208.223.208.181 security-lab1.juniper.net
The above bot fell into a bot trap. In order to do this it had to violate the rules in the robots.txt file. It is not clear why www.juniper.net is sending out a bot.
I have written to them and am waiting for a reply on what this thing is and why it was caught in a improper crawl.
In the mean time python-urllib/1.16 is added as a email harvestor since thats why I find about that useragent on other sites.
Subscribe to:
Post Comments (Atom)
1 comment:
security-lab1.juniper.net is a Tor exit node, so it is likely someone was running their bot through Juniper's hidden service.
Post a Comment