# PARTIAL access (All Spiders) User-agent: * Disallow: /admin/ Disallow: /code/ Disallow: /grabber/ Disallow: /test/ Disallow: /includes/ Disallow: /backup/