# robots.txt - removes subdirectories from web crawler's search access User-agent: * Disallow: /projects/ # do not search in any non-root directories Disallow: /private/*