# prevent indexing of the admin and company sections User-agent: * Disallow: /admin/ Disallow: /company/ Disallow: /include/ Disallow: /redirect/ Disallow: /_private/ Disallow: /scripts/ Disallow: /search/