https://robotstxtlab.net/templates/allow-search-block-ai-training2026-07-15T22:24:02+00:00https://robotstxtlab.net/templates/block-all-ai-crawlers2026-07-15T22:24:03+00:00https://robotstxtlab.net/templates/block-claude-crawlers2026-07-15T22:33:46+00:00https://robotstxtlab.net/templates/block-google-extended2026-07-15T22:33:46+00:00https://robotstxtlab.net/templates/block-gptbot2026-07-15T22:24:03+00:00https://robotstxtlab.net/templates/block-openai-crawlers2026-07-15T22:24:03+00:00https://robotstxtlab.net/templates/block-perplexity-crawlers2026-07-15T22:33:46+00:00https://robotstxtlab.net/templates/shopify-robots-txt2026-07-15T22:33:46+00:00https://robotstxtlab.net/templates/small-business-robots-txt2026-07-15T22:47:10+00:00https://robotstxtlab.net/templates/wordpress-robots-txt2026-07-15T22:33:46+00:00