User-agent: * Disallow: /cgi-bin/ Disallow: /.old/ Disallow: /!!admin/ Disallow: /.cache/ Disallow: /forum30/ Disallow: /forum-disabled/ Disallow: /forum/ Allow: /forum/$ Allow: /forum/index.php Allow: /forum/viewforum.php Allow: /forum/viewtopic.php Disallow: /about/add-char Disallow: /about/add-anime Disallow: /about/add-hdloader Disallow: /about/search-results.php Disallow: /!index/ Disallow: /image.php Disallow: /discord.php # Block filter/sort query-string variants of list pages — canonical URLs # like /anime/a, /hdloader/r etc. are still crawlable. /gallery?page=N is # the canonical for paginated gallery index pages, and /gallery/?page= # is the canonical for paginated letter buckets, so allow both through. Disallow: /anime? Disallow: /chars? Disallow: /hdloader? Disallow: /gallery? Disallow: /reviews? Allow: /gallery*?page= # Stray filter/sort parameters anywhere on the site. Disallow: /*?sort= Disallow: /*?text= Disallow: /*?page= Disallow: /*?preview= Disallow: /*?print_me= Disallow: /*?skin_set= Disallow: /*?display_mode=