User-agent: ImageWalker Disallow: / User-agent: gsa-crawler Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: trovitBot Disallow: / User-agent: RealSpider Disallow: / User-agent: Updownerbot Disallow: / User-Agent: MJ12bot Crawl-Delay: 20 Disallow: /tcd/ Disallow: /microsite/ Disallow: /*ajax.htm$ Disallow: /*fragment.htm Disallow: /image/viewer.htm Sitemap: https://www.reagordykesmitsubishiamarillo.com/sitemap.xml Sitemap: https://www.reagordykesmitsubishiamarillo.com/videositemap.xml User-agent: Slurp Crawl-Delay: 10 Disallow: /tcd/ Disallow: /microsite/ Disallow: /*ajax.htm$ Disallow: /*fragment.htm Disallow: /image/viewer.htm User-agent: * Crawl-Delay: 3 Disallow: /tcd/ Disallow: /microsite/ Disallow: /*ajax.htm$ Disallow: /*fragment.htm Disallow: /image/viewer.htm Disallow: /apis/mycars/ Disallow: /mycars/ Disallow: /reserve-it-now/form.htm Disallow: /specials/trims.htm Disallow: /inventory-details/print.htm