User-agent: Scrapy Allow: / User-agent: * Disallow: Disallow */?o= Disallow */?0*= Disallow */?1*= Disallow */?2*= Disallow */?3*= Disallow */?4*= Disallow */?5*= Disallow */?6*= Disallow */?7*= Disallow */?8*= Disallow */?9*= Disallow */1000$ Disallow: /kalkulator-test/ Sitemap: https://fullbax.pl/sitemap_index.xml #WP Import Export Rule User-agent: * Disallow: /wp-content/uploads/wp-import-export-lite/ # --- AI Search Crawlers - ZEZWOL (widocznosc w AI search) --- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / # --- AI Training Crawlers - ZABLOKUJ (nie chcemy trenowac modeli nasza trescia) --- User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: anthropic-ai Disallow: / User-agent: cohere-ai Disallow: /