User-agent: Googlebot Disallow: /awstat/ Disallow: /crawling/ Disallow: /cgi-bin/ Disallow: /inc/ Disallow: /page.restrictor.log Disallow: /page.restrictor.php Disallow: /smsdate_dateads.php User-agent: * Disallow: /awstat/ Disallow: /crawling/ Disallow: /cgi-bin/ Disallow: /inc/ Disallow: /page.restrictor.log Disallow: /page.restrictor.php Disallow: /smsdate_dateads.php