http://www.netvouz.com/fjordaan/tag/robots?feed=rss fjordaan's bookmarks tagged "robots" on Netvouz http://www.ahref.com/guides/technology/200009/0922piou2.html fjordaan Fri, 28 Jun 2002 17:30:58 GMT http://www.chipcom.net/searchengine6.php fjordaan Thu, 01 Nov 2001 23:40:40 GMT http://www.user-agents.org/index.shtml fjordaan Sun, 04 Mar 2007 18:30:20 GMT http://www.flickr.com/photos/44124312001@N01/sets/125732/ fjordaan Thu, 05 Jan 2006 22:55:52 GMT http://www.nextthing.org/archives/2007/03/12/robotstxt-adventure Last October I got bored and set my spider loose on the robots.txt files of the world. Having had a good deal of positive feedback on my HTTP Headers survey, I had decided to poke around in robots.txt files and see what sorts of interesting things I could find. fjordaan Thu, 04 Oct 2007 12:06:04 GMT http://googlewebmastercentral.blogspot.com/2008/06/improving-on-robots-exclusion-protocol.html Today, in that same spirit of making the lives of webmasters simpler, we're releasing detailed documentation about how we implement REP. This will provide a common implementation for webmasters and make it easier for any publisher to know how their REP directives will be handled by three major search providers -- making REP more intuitive and friendly to even more publishers on the web. fjordaan Wed, 04 Jun 2008 13:04:43 GMT http://www.robotstxt.org/wc/faq.html fjordaan Mon, 25 Mar 2002 23:19:28 GMT http://www.tweenbots.com/ Tweenbots are human-dependent robots that navigate the city with the help of pedestrians they encounter. Rolling at a constant speed, in a straight line, Tweenbots have a destination displayed on a flag, and rely on people they meet to read this flag and to aim them in the right direction to reach their goal. fjordaan Thu, 16 Apr 2009 09:19:46 GMT