# Robots.txt file from http://www.searchengineworld.com # # Allow all robots to spider this domain # see also http://searchengineworld.com/metatag/robots.htm # for robots meta tag usage User-agent: * Disallow: /cgi-bin/