User-agent: * #Disallow: /*? #block any URL that includes a ? (more specifically, it will block any URL that begins with your domain name, followed by any string, followed by a question mark, followed by any string Disallow: /*.zip$ Disallow: /*.pxp$ #Disallow: /*.swf$ # Cappuccino/Aristo Disallow: /ot/-misc/cappuccino/Frameworks/ Disallow: /ot/-misc/classes/ Disallow: /data/ Allow: /data/DIN-Visus-2010/ Disallow: /*Browser.environment/ Disallow: /*.cib$ Disallow: /*.sj$ #Disallow: /*.js$ #Disallow: /*.blend/ #Disallow: /*.cur$