# Allow every crawler. Named AI / answer-engine crawlers are listed # explicitly below because a named group REPLACES the wildcard group, # so each one repeats the same rules rather than getting wider access. # See /llms.txt for a structured overview of this site. User-agent: * Allow: / # Commerce endpoints hold no indexable content. Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # AI / LLM / answer-engine crawlers - explicitly welcomed (AEO/GEO). # OpenAI / ChatGPT User-agent: GPTBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: OAI-SearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ChatGPT-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ChatGPT Agent Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: OpenAI Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Operator Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Anthropic / Claude User-agent: ClaudeBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Claude-Web Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Claude-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Claude-SearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Claude-Code Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: anthropic-ai Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Google: Gemini, AI Overviews, NotebookLM, Vertex User-agent: Google-Extended Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: GoogleOther Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: GoogleOther-Image Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: GoogleOther-Video Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Google-CloudVertexBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: CloudVertexBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Gemini-Deep-Research Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Google-NotebookLM Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: NotebookLM Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Google-Gemini-CLI Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Google-Firebase Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Google-Agent Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: GoogleAgent-Mariner Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: GoogleAgent-URLContext Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Perplexity User-agent: PerplexityBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Perplexity-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Apple Intelligence User-agent: Applebot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Applebot-Extended Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Microsoft / Azure AI User-agent: AzureAI-SearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Meta AI User-agent: meta-externalagent Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Meta-ExternalAgent Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: meta-externalfetcher Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Meta-ExternalFetcher Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: meta-webindexer Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: FacebookBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: facebookexternalhit Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Amazon: Alexa, Kendra, Q, Bedrock, Rufus User-agent: Amazonbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Amzn-SearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Amzn-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: amazon-kendra Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: amazon-QBusiness Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: AmazonBuyForMe Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: bedrockbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Moonshot AI / Kimi User-agent: Kimi-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # DeepSeek User-agent: DeepSeekBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Alibaba / Qwen (Tongyi) User-agent: TongyiBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Zhipu AI / GLM User-agent: ChatGLM-Spider Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Baidu / ERNIE User-agent: YiyanBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Huawei / Pangu User-agent: PanguBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: PetalBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # ByteDance / Doubao, TikTok User-agent: Bytespider Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: TikTokSpider Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Mistral User-agent: MistralAI-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: MistralAI-User/1.0 Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Cohere User-agent: cohere-ai Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: cohere-training-data-crawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Yandex AI User-agent: YandexAdditional Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: YandexAdditionalBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # AI-native search and answer engines User-agent: YouBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: PhindBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ExaBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ExaSearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: kagi-fetcher Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Bravebot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: DuckAssistBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: LinerBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: iAskBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: iaskspider Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: iaskspider/2.0 Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: TavilyBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: LinkupBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: AddSearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Andibot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: QueritBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Querit-SearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: WRTNBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Channel3Bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: bigsur.ai Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Open datasets and crawls that feed model training User-agent: CCBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: AI2Bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: AI2Bot-DeepResearchEval Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Ai2Bot-Dolma Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: omgili Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: omgilibot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ImagesiftBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: imageSpider Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: img2dataset Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: LAIONDownloader Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: laion-huggingface-processor Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Webzio-Extended Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: webzio-extended Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: FriendlyCrawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: VelenPublicWebCrawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: SBIntuitionsBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ICC-Crawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= # Other AI crawlers, agents, assistants and dataset collectors User-agent: AgentTimes Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: aiHitBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: AIWebIndex Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Anomura Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ApifyBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ApifyWebsiteContentCrawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Aranet-SearchBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: atlassian-bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Awario Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Brightbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Brightbot 1.0 Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: BuddyBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Cloudflare-AutoRAG Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Code Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Cotoyogi Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: CragCrawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Crawl4AI Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Crawlspace Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Cursor Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Datenbank Crawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Devin Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Diffbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Echobot Bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: EchoboxBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Factset_spyderbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: FirecrawlAgent Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: GeistHaus-PageFetcher Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: HenkBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ISSCyberRiskCrawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Kangaroo Bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: KlaviyoAIBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: KunatoCrawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: LCC Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Lightpanda Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Linguee Bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Manus-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Mozilla-Tabstack Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: MyCentralAIScraperBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: NagetBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: netEstate Imprint Crawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: newsai Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: NovaAct Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: opencode Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Panscient Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: panscient.com Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Poggio-Citations Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Poseidon Research Crawler Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: QualifiedBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: QuillBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: quillbot.com Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Scrapy Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: SemrushBot-OCOB Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: SemrushBot-SWA Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Shap-User Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ShapBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Sidetrade indexer bot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Spider Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Terra Cotta Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: TerraCotta Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Thinkbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Timpibot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: Trae Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: TwinAgent Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: UseAI Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: WARDBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: wpbot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: YaK Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= User-agent: ZanistaBot Allow: / Disallow: /checkout/ Disallow: /cart/ Disallow: /thanks-for-order/ Disallow: /thanks/ Disallow: /api/ Disallow: /*?add-to-cart= Disallow: /*?q= Sitemap: https://topghlsnapshots.com/sitemap_index.xml