http://searchengineinfo.net Search engine info last info about Google , Yahoo and Msn 2012-05-17 05:20:49 Search Engine Info - http://searchengineinfo.net http://searchengineinfo.net/read_new13.html There are plenty of bots out there and, as a result, some conventions have arisen.  Well-behaved bots identify themselves with a unique user-agent.  They also follow the robots.txt conventions, which allow webmasters to control how their sites are crawled.   Here at Live Search, our crawlers are identified by the user-agent ‘MSNBot’.  This may seem a little non-intuitive, but many webmasters depend on this, and so... 2006-11-29 14:37:00