User-Agent: *
Allow: /
Disallow: /assets
Disallow: /core
Disallow: /connectors
Disallow: /config.core.php
Disallow: /master.html