Best robots.txt plugins for WordPress

WP Robots Txt

Up in the last 7 days:2#854

by George Pattichis2 months ago

WP Robots Txt Allows you to edit the content of your robots.txt file.

Virtual Robots.txt

Down in the last 7 days:3#874

by Marios Alexandrou2 months ago

Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.

Robots.txt Editor

Up in the last 7 days:1#1,916

by Processby5 years ago

Robots.txt for WordPress

Better Robots.txt

Down in the last 7 days:5#3,048

by Pagup12 days ago

Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …

Block AI Crawlers

Up in the last 7 days:68#4,872

by lastsplash (a11n)8 days ago

Adds robots.txt rules blocking AI crawlers and AI bots.

Multipart robots.txt editor

Down in the last 7 days:6#5,179

by Viktor Szépe8 years ago

Customize your site's robots.txt and include remote content to it

Robots.txt rewrite

Down in the last 7 days:16#5,837

by Eugen Bobrowski9 years ago

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Magic robots.txt

Down in the last 7 days:3#6,350

by ABCdatos2 months ago

This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.

Known Agents

Up in the last 7 days:27#6,623

by Known Agents5 months ago

Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.

AI Content Signals

Up in the last 7 days:53#7,344

by Fernando Tellado2 months ago

Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.

Robots.txt Quick Editor

Up in the last 7 days:76#7,372

by davide.airaghi3 years ago

Plugin to edit robots.txt file

Admin Robots.txt Editor

Up in the last 7 days:8#7,596

by Karan Makani2 months ago

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

Search engines blocked warning

Down in the last 7 days:27#9,110

by apasionados9 months ago

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

AI Scrape Protect

Up in the last 7 days:175#9,222

by Daan Verbaan1 month ago

Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML ``.

Block Archive.org via WordPress robots.txt

Up in the last 7 days:7#9,422

by apasionados9 months ago

Blocks the archive.org bots through the WordPress virtual robots.txt file.

Bisteinoff SEO Robots.txt

Down in the last 7 days:55#9,661

by Denis Bisteinov10 months ago

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

iRobots.txt SEO

Up in the last 7 days:41#11,781

irobotstxt-seo16 years ago

iRobots.txt SEO is a SEO optimized, secure and customizable robots.txt virtual file creator.

Robots Meta Whiz

Up in the last 7 days:47#16,405

by Marat Nepomnyashy9 years ago

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

MetaRobots by SEO-Sign

Up in the last 7 days:51#16,530

by Artem Pilipets11 years ago

The easiest way to manage meta robots tag.

Block eCommerce Assets via robots.txt

Up in the last 7 days:2#16,789

by apasionados3 years ago

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Block Chat GPT via robots.txt

Down in the last 7 days:250#16,893

by apasionados3 years ago

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

Forge AI Bot Log

Up in the last 7 days:115#17,014

by forgecreative20 days ago

Detect, verify and block AI crawlers, bots and scrapers. Vendor IP lists and reverse-DNS checks flag spoofed user agents, not trust them.

Check Search Engine Visibility on Migration

Down in the last 7 days:28#18,910

by Rhys Wynne11 months ago

Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.

Unblock CSS & JS for Googlebot

Down in the last 7 days:192#20,877

by Miina Sikk10 years ago

Modifies robots.txt to allow Googlebot access JS and CSS files.

CeeWP Robots.txt Manager

Down in the last 7 days:517#22,058

by CeeWP1 year ago

Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

Copyright AI Content Licensing

Up in the last 7 days:522#23,403

by Tyler Martin9 months ago

AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

AI Deny

#23,511

by Code For Broke1 month ago

Block 30+ AI crawlers in your robots.txt, including GPTBot, ClaudeBot and CCBot, and choose exactly which bots get in.

SEO & AI Readiness Check

#24,604

by meinseocoach9 days ago

See what search engines and AI crawlers find on your site: titles, meta, H1, schema, sitemap, GPTBot access and llms.txt. No account needed.

Mephivio Robots LLMs

Up in the last 7 days:480#24,638

by Mephivio28 days ago

Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.

IntentDeep Virtual Files

Down in the last 7 days:152#25,148

by IntentDeep8 months ago

Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.

AI Blackout

Up in the last 7 days:1,001#26,704

by LazyCodeLab1 month ago

Stop AI companies scraping your posts to train their chatbots. Block AI crawlers, state your terms, and switch off the AI inside WordPress.

Block Feed and Comments via robots.txt

Down in the last 7 days:90#26,887

by apasionados3 years ago

Blocks some Feed and Comment resources in order to avoid spam bots

Block Common Crawl via robots.txt

#27,849

by apasionados3 years ago

Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

SEO Auditor Tools

#30,598

by Fernando Fas1 month ago

Scan your WordPress site for SEO issues and get actionable fixes. Includes AI Helper, sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analy …

Hack The SEO

#30,600

by Hack The SEO4 days ago

Connect Claude to your site. See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot) read your pages. Free, runs next to your SEO plugin.

HumanGate

#31,452

by DarkAI10 months ago

Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.

ProAI TXT Manager for LLMS and Robots

Down in the last 7 days:1,497#32,261

by ProAI1 year ago

Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.

LJPL Armored robots.txt

#32,272

by Lukasz Jasinski13 years ago

Add some directives to your robots.txt file to keep your site safer

GoBookMart Robots Editor

Up in the last 7 days:71#32,815

by Gobookmart11 months ago

A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

ChatBot Blocker by CellarWeb

Down in the last 7 days:445#33,288

by Rick Hellewell2 years ago

ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

Sitemapster

Up in the last 7 days:24,931#41,910

by Matt Biscay27 days ago

Help search engines discover your content with fast XML and image sitemaps, smart caching, and simple controls. WooCommerce support in Pro.

Thin Content Manager

#44,983

by msfreed12 years ago

See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

LLMs.txt Generator & AI Crawler Control

Up in the last 7 days:616#46,022

by Four47 Labs10 days ago

Generate llms.txt, manage robots.txt, control AI crawlers and audit your WordPress site's technical readiness for GEO and AI visibility.

Robots.txt Extender

Up in the last 7 days:1,959#46,350

by bettoadami6 years ago

Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

Seenby AI Access Check

#48,617

by citedby10 days ago

One button in wp-admin shows whether AI-search crawlers can read your site: robots.txt, llms.txt, sitemap and a free page check.

Misha Manko AI Bot Access Checker

#50,211

by mishamanko1 month ago

See which AI bots can reach your site - ChatGPT, Claude, Perplexity, Google AI and more - and why the others are blocked.

Markaevi AI Crawler Control

Up in the last 7 days:11,566#50,394

by yagmuryurtsever3 months ago

Establish full control over LLM crawlers and optimize your website framework for conversational AI engines.

BotGate

Up in the last 7 days:10,336#50,803

by Anil12 days ago

Choose which AI bots can read your content, and publish an llms.txt file for AI search tools.

IndexMesh

Up in the last 7 days:10,944#50,823

by Xavier Emerson19 days ago

Control AI crawlers, publish llms.txt, coordinate schema ownership, and verify live output. Free, local, and SEO-plugin compatible.

AI Crawler Control by Citlyze

#50,994

by citlyze1 day ago

Control GPTBot, ClaudeBot and PerplexityBot in robots.txt, get alerts when AI search gets blocked, audit posts for AI answers, and manage llms.txt.