# A Note to all Crawlers:
# =======================
# This site has a lot of pages and some crawlers visit this
# site far too often. If you are found
# to crawl this site excessively, you may be blocked.
#
# Please also consider the links you crawl. Your bot may be
# tricked into initiating internal searches on this site that contain 
# pharma terms or similar, with a view to negatively impacting seo. 
# Play fair, and you'll be able to continue crawling this site.
# Thank you.
# -----------------------
User-agent: *
Allow: /wp-admin/admin-ajax.php
Allow: /betting-agencies-australia/
Disallow: /wp-admin/
Disallow: /*?s=*
Disallow: /*feed/

User-agent: BLEXBot
Disallow: /

Sitemap: https://www.races.com.au/sitemap.xml