# All robots will spider the domain User-agent: * Disallow: /test/ Disallow: /upload/ Disallow: /_private/ Disallow: /_borders/ Disallow: /_fpclass/ Disallow: /MM_CASETEST4291/ Disallow: /db/ Disallow: /cgi-bin/ Disallow: /ftp/ Disallow: /stats/ Disallow: /newsletters/