# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding # use. # (b) If a Content-Signal = no, you may not collect content for the # corresponding use. # (c) If the website operator does not include a Content-Signal for a # corresponding use, the website operator neither grants nor restricts # permission via Content-Signal with respect to the corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from your website's contents). Search does not # include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval # augmented generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # use: how AI systems may consume the content (immediate, reference, or full). # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT # AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. # BEGIN Cloudflare Managed content User-agent: * Content-Signal: search=yes,ai-train=no,use=reference Allow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CloudflareBrowserRenderingCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / # END Cloudflare Managed Content # PM DAS Solutions — crawler policy # # The rule this file implements, in one line: you may READ this site and # QUOTE it with a link back. You may not INGEST it into a model. # # That is the same line legal.html already draws in prose ("Except for search # engine crawlers indexing this site for ordinary search results...") and the # same line the free reference layer is licensed on (see /license.html: # distribute unaltered, attribution required). This file states that policy # to machines. # # Two kinds of AI crawler exist and they are not the same business: # # RETRIEVAL / CITATION bots read a page at the moment a person asks a # question and answer with a link back. That is a referral. It is the same # deal Google offers, and for a site whose whole wedge is being the # jurisdiction-resolved answer to "who is the AHJ here", it is the single # most valuable traffic there is. These are ALLOWED below. # # TRAINING bots ingest the content into a model. No link, no attribution, # no referral, permanently. These are BLOCKED below, and legal.html # reserves the right to license that use separately. # # NOTE: vendors rename and repurpose these agents. Re-check this list against # each vendor's published bot documentation periodically -- an agent moving # from retrieval to training is exactly the change this file exists to catch. # `node scripts/audit-live.mjs` verifies the live file still matches this # intent and fails if a citation bot has been blocked or a training bot let in. # --------------------------------------------------------------------------- # Everything else: crawl freely. # --------------------------------------------------------------------------- User-agent: * Allow: / # Private / non-public surfaces — keep out of the index. Disallow: /hub.html Disallow: /analytics.html # --------------------------------------------------------------------------- # ALLOWED — search and AI answer engines that cite with a link. # Listed explicitly rather than left to the wildcard so the intent is on the # record, and so a future blanket block cannot silently swallow them. # --------------------------------------------------------------------------- # Classic search User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / # Applebot powers Siri and Spotlight search results. Distinct from # Applebot-Extended, which is the model-training arm and is blocked below. User-agent: Applebot Allow: / # AI answer engines: these retrieve at query time and cite the source. User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / # --------------------------------------------------------------------------- # BLOCKED — model training and bulk ingestion. # Blocking these does NOT affect search ranking. Google-Extended in # particular governs Gemini training only; Googlebot above is untouched by it. # --------------------------------------------------------------------------- User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: Diffbot Disallow: / User-agent: Omgili Disallow: / User-agent: Omgilibot Disallow: / User-agent: YouBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Timpibot Disallow: / Sitemap: https://pmdassolutions.com/sitemap.xml