# All robots will spider the domain User-agent: * Disallow: utility # Disallow directory site User-agent: * Disallow: tools