Sitemap: http://www.camgirlsex.net/sitemap.xml # =================================== # Folgende Seiten sollen nicht indexiert werden: # =================================== User-agent: * Disallow: /cgi-bin/ Disallow: /logogfx/ Disallow: /scripts/ Disallow: /Bilder/ Disallow: /cgi-bin/ Disallow: /index/ Disallow: /styles/ Disallow: /includes/ Disallow: /includes/pps/ Disallow: /includes/pp-wahl/ Disallow: /includes/ Disallow: /includes/pp-wahl/pp1/ Disallow: /includes/scripts/ Disallow: /includes/textcontent/ # =================================== # Schließe folgende Spider komplett aus: # =================================== User-agent: WebReaper User-agent: WebCopier User-agent: Offline Explorer User-agent: HTTrack User-agent: Microsoft.URL.Control User-agent: EmailCollector Disallow: /