# robots.txt web spider exclusion policy

User-agent: *
Disallow: /pro/
Disallow: /etc/
Disallow: /bin/
Disallow: /data/