tag:blogger.com,1999:blog-33923218.post7852770200929390762..comments2023-05-01T05:29:14.390-05:00Comments on Web Robots: 67.202.15.206 compute-1.amazonaws.com www.powerset.comUnknownnoreply@blogger.comBlogger1125tag:blogger.com,1999:blog-33923218.post-9474661398240627142008-11-27T04:38:00.000-06:002008-11-27T04:38:00.000-06:00From my Apache HTTPD.CONF:# stop amazonaws address...From my Apache HTTPD.CONF:<BR/># stop amazonaws addresses scraping /jargon<BR/>RewriteEngine on<BR/>RewriteCond %{REMOTE_HOST} ^.*\.compute-1\.amazonaws\.com$ [NC]<BR/>RewriteCond %{REQUEST_URI} ^.*/jargon/.*\.html$ [NC]<BR/>RewriteRule !^/jargon/index\.html$ /jargon/index.html [L,R=permanent]<BR/><BR/>(excuse the wrap)Anonymousnoreply@blogger.com