robots.txt generator
This script lets you browse through your server�s directory structure. If a robots.txt is found, it is read and the appropriate allowed/disallowed folders are checked/unchecked. Just change the checkers and hit the �update� button to update the robots.txt. You may also delete the file or edit the comment. Changes are always made to �User-agent: *�. Additionally the script warns, if no index-files or htaccess files were found. Updated: Now PHP 4.2 security conform.