No means no

From another website’s logs, one year ago:

66.151.189.9 - - [30/Aug/2004:00:14:50 -0400] "GET /blog/rss2.xml HTTP/1.1" 410 1112 "-" "Feedster Crawler/1.0; Feedster, LLC.; Crawler #"

From the same site’s logs today:

64.95.116.1 - - [02/Sep/2005:23:24:49 -0400] "GET /blog/rss2.xml HTTP/1.1" 410 1113 "-" "Feedster Crawler/1.0; Feedster, Inc."

Hey Feedster, ya bunch of dorks, why is it that every other feed spider seems to understand this but your crawler doesn’t?

The requested resource is no longer available at the server and no forwarding address is known. This condition is expected to be considered permanent. [… The] resource is intentionally unavailable and [the] server owners desire that remote links to that resource be removed.

Published by