User-agent: * Disallow: /*?limit Disallow: /*&limit Disallow: /*?sort Disallow: /*&sort Disallow: /*?route=checkout/ Disallow: /*?route=account/ Disallow: /*?route=product/search Disallow: /*&Itemid Disallow: /*&view Disallow: /*&tag Disallow: /*&order Disallow: /*&page Disallow: /*&filter Disallow: /*?tag= Disallow: /*?path= Sitemap: https://www.craftbeersdelivered.com/index.php?route=extension/feed/google_sitemap User-agent: Slurp Disallow: * User-agent: twiceler Disallow: * User-agent: Gigabot Disallow: * User-agent: Scrubby Disallow: * User-agent: Nutch Disallow: * User-agent: ia_archiver Disallow: * User-agent: baiduspider Disallow: * User-agent: psbot Disallow: * User-agent: asterias Disallow: * User-agent: yahoo-blogs/v3.9 Disallow: * User-agent: *MegaIndex* Disallow: * User-agent: *BLEXBot* Disallow: * User-agent: MJ12bot Disallow: * User-agent: SemrushBot* Disallow: * Disallow: /pdfs/ Disallow: *.pdf User-agent: * Crawl-delay: 5