User-agent: * 
Disallow: /web/css/
Disallow: /web/images/
Disallow: /web/includes/
Disallow: /web/js/