# /robots.txt file for +VE website # allow all web-crawler agents but prevent crawling of some directories User-agent: * Disallow: /dlls Disallow: /helper Disallow: /install Disallow: /jobs Disallow: /logs Disallow: /upgrade