# /robots.txt file for http://www.groenlinks.nl # We staan een boel niet toe, het enige dat we toestaan is de voorpagina # en /lidworden # Alleen google toegestaan nu i.v.m. performance. User-agent: Googlebot Disallow: /search Disallow: /2ekamer/ Disallow: /1ekamer/ Disallow: /europa/ Disallow: /lokaal/ Disallow: /nieuwsoverzicht/ Disallow: /nieuwsbrief/ Disallow: /politici/ Disallow: /agenda/ Disallow: /actie/ Disallow: /standpunten/ Disallow: /publicaties/ Disallow: /dossiers/ Disallow: /partij/ Disallow: /actief/ Disallow: /jongeren/ Disallow: /winkel/ Disallow: /contact/ Disallow: /kader/ User-agent: Googlebot-Image Disallow: / User-agent: MSNBot Disallow: / User-agent: Slurp Disallow: / User-agent: Teoma Disallow: / User-agent: Gigabot Disallow: / User-agent: Scrubby Disallow: / User-agent: Robozilla Disallow: / User-agent: Nutch Disallow: / User-agent: ia_archiver Disallow: / User-agent: baiduspider Disallow: / User-agent: yahoo-mmcrawler Disallow: / User-agent: psbot Disallow: / User-agent: asterias Disallow: / User-agent: yahoo-blogs/v3.9 Disallow: / User-agent: * Disallow: /