# Crawl-delay is integer seconds User-agent: spider Disallow: / User-agent: * Crawl-Delay: 30 Disallow: /cgi-bin/ Disallow: /emb/ Disallow: /entropybanner/ Disallow: /images/ Disallow: /karin/images/ Disallow: /mail/ Disallow: /main/ Disallow: /marc/hot/ Disallow: /rtw/images/ Disallow: /secret/ #Disallow: /travel/dispatches/ Disallow: /travel/gallery/images/ Disallow: /travel/images/ Disallow: /WysiwygPro/ Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.pdf$ Disallow: /*.rtf$ Disallow: /*.zip$ Disallow: /library/