Етикет на разширения: robots.txt
-
-
Check Search Engine Visibility on Migration
(1 общо оценки)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
AI Deny
(1 общо оценки)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Unblock CSS & JS for Googlebot
(0 общо оценки)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 общо оценки)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Block Common Crawl via robots.txt
(0 общо оценки)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 общо оценки)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Feed and Comments via robots.txt
(0 общо оценки)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 общо оценки)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ChatBot Blocker by CellarWeb
(0 общо оценки)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 общо оценки)Add some directives to your robots.txt file to keep your site safer
-
ProAI TXT Manager for LLMS and Robots
(1 общо оценки)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
HumanGate
(0 общо оценки)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Thin Content Manager
(1 общо оценки)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 общо оценки)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
Advanced SEO Toolkit
(0 общо оценки)Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
-
Block old browser versions and suspicious browsers
(0 общо оценки)With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
-
Check System Details
(0 общо оценки)Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.
-
AI Crawlers Visibility, Analytics & Control
(0 общо оценки)AI crawlers monitoring for WordPress — track GPTBot, ClaudeBot, and 68+ bots with analytics, robots.txt rules, PHP blocking, and visibility scoring.
-
LLMs.txt – AI Website Content Crawling
(0 общо оценки)Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.