A new bot just showed up claiming another beta test.
This bot is blocked by Bad Behaivor for using improper headers.
Could you elaborate on the problem with the headers? I'm eager to fix real an perceived problems with our crawler.
Here is the BB error
bad-behavior 403 Required header 'Accept' missing
Agent: Mozilla/5.0 (compatible; woriobot heritrix/1.10.0 +http://worio.com)
Your just going to have to test it on a blog using Bad Behavior.
If it were a worthwhile bot I would whitelist it but since it doesn't do anything yet why bother. If your project ever gets off the ground let me know and I will erase this post.