Best robots.txt plugins for WordPress

All-IN Crawler & AI Agent Manager

#51,246

by Eli Shvarzman2 days ago

Allow, rate-limit or block bots, AI crawlers and scrapers, and stay visible to search engines and AI assistants.

Phylax AI Crawler Inspector

Up in the last 7 days:5,480#51,675

by Łukasz Nowicki2 months ago

Inspect how this site responds to AI-related agents. Audit robots.txt, llms.txt, redirects, headers and HTML without changing the site.

RankRoot

#52,277

by zuestable18 days ago

Control which AI bots can crawl you, check your site is readable by ChatGPT, Perplexity and Claude, and serve llms.txt and brand schema.

Foundash AI Access Check

Up in the last 7 days:5,182#53,132

by boiledpotat02 months ago

Find out whether ChatGPT, Claude, Perplexity and Google's AI can actually read your website. Takes about ten seconds.

HitMind

Up in the last 7 days:14,625#53,181

by hitmind15 days ago

See what your robots.txt really tells GPTBot, ClaudeBot, PerplexityBot and 17 other AI crawlers, and catch blocked paths they can still reach.

A3 Robots Warning

#55,376

by vaniivan7 years ago

Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.

Seeallseo

#55,503

by seeallseo27 days ago

SEO audit and GEO audit for any post or page: AI search readiness, 41 checks, three scores and clear steps to fix each issue. No account needed.

VisitorType

Down in the last 7 days:3,630#56,102

by stitchengineer3 months ago

Verified AI crawler analytics: claimed bots are checked against vendor IP ranges — impostors get flagged. Fire different tags per visitor type.

Advanced SEO Toolkit

Down in the last 7 days:843#57,544

by Mehdi Rezaei2 years ago

Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.

Serfe AI Discovery

#58,661

by Serfe6 days ago

AI discovery for WordPress: publish llms.txt, robots.txt signals, Markdown, and Link headers.

PressHangar AI Citations

#58,709

by presshangar1 month ago

Generate llms.txt and control AI crawlers (GPTBot, ChatGPT) via robots.txt and IndexNow — so your content is found and cited by AI search.

JustWhat SEO Audit

#59,181

by Justin Adams2 days ago

Technical SEO checks in wp-admin: titles, descriptions, indexing, canonicals, structured data, broken links, robots.txt, sitemaps, AI crawlers.

SEO Sentry

Down in the last 7 days:3,675#59,520

by SEO Sentry7 days ago

Get an alert when a page goes noindex, or its title, canonical, schema, robots.txt or sitemap changes. Includes an SEO health check.

Block old browser versions and suspicious browsers

Up in the last 7 days:11,406#60,646

by hupe1324 days ago

With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.

Ekom SEO Toolkit

Down in the last 7 days:9,644#60,907

by itsekomagain1 day ago

All-in-one local SEO toolkit for WordPress. Site audits, redirects, robots.txt, and Gutenberg editor panels — no cloud, no account, no license key.

Zulkaif Seo File Manager

Up in the last 7 days:11,295#61,087

by Zulkaif Riaz8 months ago

Generate and control sitemaps, robots.txt, ads.txt, and other essential SEO files with full transparency and no silent automation.

Markaevi AI Crawler Control

Up in the last 7 days:9,985#61,118

by yagmuryurtsever3 months ago

Establish full control over LLM crawlers and optimize your website framework for conversational AI engines.

LLMs.txt

#61,339

by Magazine31 year ago

Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.

AKSA AI Monitor

Up in the last 7 days:8,165#61,461

by mikiaksa3 months ago

Measure detected AI crawler activity, see which content is accessed, identify AI referral visits, and manage bot access locally.

IndexMesh

Up in the last 7 days:3,627#62,030

by Xavier Emerson20 days ago

Control AI crawlers, publish llms.txt, coordinate schema ownership, and verify live output. Free, local, and SEO-plugin compatible.

ddosNull AI Crawler & Scraper Blocker

Up in the last 7 days:4,403#62,098

by ddosnull1 month ago

Block GPTBot, ClaudeBot, Bytespider and 170+ AI crawlers and scrapers, bot by bot. Blocks by user agent and robots.txt. Optional daily list updates.

Everlange Connect

Down in the last 7 days:2,848#62,898

by Everlange2 months ago

Free llms.txt and AI-crawler robots.txt for your site, generated locally — no account needed. Get cited by ChatGPT, Perplexity, Claude and Gemini.

Drishti GEO

#63,097

by Techeshta1 month ago

Tracks website and brand visibility across major AI engines using your choice of API provider, featuring a native robots.txt blocker alert.

SoftGlaze AI Crawler Monitor

Up in the last 7 days:486#63,183

by Azhar Ali16 days ago

See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.

Search Visibility (AI & GEO Audit)

Up in the last 7 days:2,409#63,256

by Abuzer18 days ago

On-site SEO & GEO audits, AI image alt text generator, AI crawler insights, robots.txt testing, and prioritized website visibility checklists.

Laudia Connect

Up in the last 7 days:7,591#63,588

by laudia2 months ago

A narrow, auditable connection that lets Laudia publish only the AI-visibility fixes you approve. Nothing else.

Elthian AI Licensing Lite

#63,962

by elthianlabs5 months ago

Manage how AI models interact with your content. Implements llms.txt, robots.txt, AI Sitemaps, and machine-readable JSON policies.

Vinvin AI Visibility Tools

#64,018

by vinvin276 days ago

See what AI assistants can read on your site, and decide which AI crawlers may use it: a readiness checklist and purpose-based crawler controls.

AI Crawler Control by Citlyze

Down in the last 7 days:11,931#64,194

by citlyze2 days ago

Control GPTBot, ClaudeBot and PerplexityBot in robots.txt, get alerts when AI search gets blocked, audit posts for AI answers, and manage llms.txt.

CiteBoost GEO

#64,202

by Team CiteBoost29 days ago

Optimize your WordPress site for AI search engines like ChatGPT, Claude, Gemini, and Perplexity.

FabriSite Sitemapy SEO

#65,025

by fabrisite1 month ago

Conector oficial da plataforma Sitemapy. Sincroniza Sitemaps XML, Robots.txt, contexto para IAs (llms.txt) e indexação via IndexNow.

AI Rights Protection by SimpleFeed

#65,066

by Alex Khomichenko1 year ago

Protect your rights by reviewing and blocking AI bots from using your content without compensation.

Citebee AI Readiness

#66,056

by jianxp0011 month ago

Lightweight GEO readiness audit: check whether robots.txt blocks AI crawlers, verify llms.txt, scan homepage Schema — plus a 0-100 score.

CrawlPod AI Visibility

#66,521

by muhammadfaizanjanjua1092 months ago

See which AI crawlers visit your site and which pages they've never fetched, control their access, and publish llms.txt. No external requests.

M7tawa LLMS.txt Manager

Up in the last 7 days:2,445#67,165

by Ayman Abdullah1 month ago

Manage llms.txt, robots.txt, and optional AI-assisted LLMS.txt and sitemap drafts through the official WordPress AI Client.

Oorank

Down in the last 7 days:11,447#68,237

by Jakaria Istauk2 months ago

Make your site readable and quotable by AI answer engines: generate llms.txt, control AI-bot access, and audit any page for AI readability.

Posterna

#68,958

by posterna6 days ago

See which AI agents and crawlers visit your site and whether they are who they say they are. Monitor only: it labels and counts, never blocks.

AumCrawl

Down in the last 7 days:10,375#69,044

by AumCreate29 days ago

See which AI crawlers read your site — GPTBot, ClaudeBot, PerplexityBot and more — verify they are who they claim, and block the ones you choose.

AI Visibility Control

Down in the last 7 days:9,184#69,514

by Techbysh1 month ago

Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.

Softrecs AI Crawler Checker

#70,043

by Alauddin Chowdhury24 days ago

Can GPTBot, ClaudeBot, PerplexityBot and Googlebot reach your site? robots.txt per bot, a live test, a bot visit log and a weekly email alert.

AWP Disallow Root Control

Down in the last 7 days:12,072#70,305

by Algorithus2 years ago

Disallow access to the root directory via robots.txt with an option to enable or disable.

VDL Search Visibility Scanner

Down in the last 7 days:16,342#70,330

by VaultDevLabs25 days ago

Check whether WordPress pages are technically discoverable with noindex, robots.txt, canonical, sitemap, redirect, and status-code checks.

ZetaRank AI Agent Access Control

#70,453

by zetarank2 months ago

Audit and control your site's visibility to AI crawlers and agents — ChatGPT, Claude, Perplexity, Gemini — from your WordPress dashboard.

Kandeshop LLMS.txt Generator

#70,551

by Darren Kandekore1 year ago

Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.

Turksem GEO SEO

Down in the last 7 days:2,764#70,804

by Turk SEM1 month ago

Track the AI bots crawling your site: GPTBot, ClaudeBot, PerplexityBot and more. Audit your SEO, control AI crawler access, and prove what changed.

shawesome robots.txt

#71,386

by shawesome1 day ago

Its own robots.txt for a single site or for every site of a multisite network – edited in the admin or deployed as a file.

AITooler Bot Analytics

#71,437

by aitooler3 months ago

See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.

GlobalDev AI Traffic Control

#71,536

by Globaldev2 months ago

Monitor identifiable AI crawler traffic and enforce access rules site-wide, per crawler, or per post, with optional llms.txt publishing.

First Page AI Readiness

Down in the last 7 days:9,436#72,189

by Joseph Mendez1 month ago

Audits technical readiness for AI crawlers, AI retrieval systems, browser-based agents, and structured content discovery.

Grubbomatic Crawl Readiness

Down in the last 7 days:3,158#72,699

by grubbomatic12 days ago

Check whether AI crawlers can read your site, then fix what they need in one click: llms.txt, AI crawler rules, meta and Open Graph tags, JSON-LD.