The new Bing Webmaster Tool can also be used to edit robots.txt files and check URLs for errors instantly.

Last year, Google open sourced the code for the robots.txt parser used in its production systems. After seeing the community build tools with it and add their own contributions to the open source ...