Best robots plugins for WordPress

XML Sitemap & Google News

#323

by Rolf Allard van Hagen5 months ago

Take control of your WordPress core XML Sitemap and add a Google News Sitemap.

WP Robots Txt

#855

by George Pattichis2 months ago

WP Robots Txt Allows you to edit the content of your robots.txt file.

Virtual Robots.txt

Down in the last 7 days:5#875

by Marios Alexandrou2 months ago

Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.

Head Meta Data

#1,705

by Jeff Starr3 months ago

Adds a custom set of <meta> tags to the <head> section of all posts & pages.

Robots.txt Editor

Up in the last 7 days:2#1,915

by Processby5 years ago

Robots.txt for WordPress

Companion Sitemap Generator

Down in the last 7 days:1#2,718

by Papin Schipper6 months ago

Create clean, complete, and up-to-date sitemaps for your WordPress website automatically.

HTTP 410 (Gone) responses

Up in the last 7 days:4#3,276

by Matt Calvert3 months ago

Sends HTTP 410 (Gone) responses for deleted content, telling search engines the page is permanently removed.

noindex SEO

Down in the last 7 days:6#3,965

by ROBOTSTXT.es2 months ago

Control search engine indexing with robots directives using HTML meta tags or HTTP headers.

Noindex Pages

Down in the last 7 days:15#4,762

by radgh10 years ago

Ask search engines not to index individual pages by checking an option in the publish post box.

mypace Custom Meta Robots

Down in the last 7 days:7#4,969

by けい (Kei Nomura)5 years ago

Description: This plugin allows you to edit the meta robots tag at every singular post(posts, pages, custom post types). This is a very simple plugin.

Multipart robots.txt editor

Down in the last 7 days:1#5,177

by Viktor Szépe8 years ago

Customize your site's robots.txt and include remote content to it

Robots.txt rewrite

Down in the last 7 days:15#5,835

by Eugen Bobrowski9 years ago

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Magic robots.txt

Down in the last 7 days:1#6,347

by ABCdatos2 months ago

This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.

Cryptex

Down in the last 7 days:3#7,283

by Andi Dittrich7 months ago

Cryptex transforms plain-text E-Mail-Addresses into Images - automatically - No scrapers. No harvesters. No spambots. That's our goal!

Robots.txt Quick Editor

Up in the last 7 days:11#7,388

by davide.airaghi3 years ago

Plugin to edit robots.txt file

Admin Robots.txt Editor

Up in the last 7 days:8#7,587

by Karan Makani2 months ago

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

Noindex Attachment Pages

Down in the last 7 days:3#8,069

by jruizcantero13 years ago

Add META ROBOTS NOINDEX to Attachment Pages in WordPress for better SEO

Search engines blocked warning

Down in the last 7 days:16#9,102

by apasionados9 months ago

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

Block Archive.org via WordPress robots.txt

Up in the last 7 days:28#9,412

by apasionados9 months ago

Blocks the archive.org bots through the WordPress virtual robots.txt file.

Robots & Sitemap

Up in the last 7 days:22#9,578

by Vo3da team5 years ago

Plugin allows easily generate sitemap.xml filе, create and edit robots.txt for your single site or multisite

Bisteinoff SEO Robots.txt

Down in the last 7 days:47#9,661

by Denis Bisteinov10 months ago

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

Disable WP Robots

Down in the last 7 days:82#11,427

by Jeff Starr5 days ago

Disables the robots meta tag added by WordPress.

Crawler Record

Up in the last 7 days:100#16,002

by dizzysoft1 month ago

Crawler Record tells you the last time each of the most common search/LLM chatbots visited (Google, ChatGPT, etc) and the pages at which they looked.

Robots Meta Whiz

Down in the last 7 days:23#16,478

by Marat Nepomnyashy9 years ago

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

Block eCommerce Assets via robots.txt

Up in the last 7 days:101#16,782

by apasionados3 years ago

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Block Chat GPT via robots.txt

Down in the last 7 days:110#16,875

by apasionados3 years ago

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

410 Delete Pages SEO

Up in the last 7 days:140#16,944

by edsteep6 years ago

Force 410 HTTP Status on listed pages, or just articles/pages that no longer exist.

Noindex by Path

Up in the last 7 days:87#19,721

by Marcin Kijak9 years ago

Ask search engines not to index individual pages by a relative path - which means you can set every url no matter it is a page, category listing or an …

Unblock CSS & JS for Googlebot

Up in the last 7 days:135#20,791

by Miina Sikk10 years ago

Modifies robots.txt to allow Googlebot access JS and CSS files.

TDMRep

Down in the last 7 days:21#21,298

by Pierre Viéville2 years ago

TDM Reservation Protocol. Control how bots and artificial intelligences like ChatGPT, GoogleBot and Bard access your content.

CeeWP Robots.txt Manager

Down in the last 7 days:133#22,062

by CeeWP1 year ago

Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

Block Feed and Comments via robots.txt

Down in the last 7 days:36#26,877

by apasionados3 years ago

Blocks some Feed and Comment resources in order to avoid spam bots

Block Common Crawl via robots.txt

Down in the last 7 days:226#27,843

by apasionados3 years ago

Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

Seo Crawlytics Data Export & Delete

#29,648

by apasionados3 years ago

Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

WP Robots Log

#29,862

by Arefly12 years ago

Log the Search Engine Robots Visits of your Webite. 取得搜索引擎的蜘蛛訪問網站的記錄

U&AI SEO Bridge

Down in the last 7 days:7#30,295

by ybriki2 months ago

Writes SEO title, meta description, canonical, robots and JSON-LD into fields WordPress themes actually render, via a small REST namespace.

Robots “noindex,follow” meta tag

#32,589

by rodhomor8 years ago

Add robots "noindex,follow" meta tags to archives, tag pages and category pages in order to preserve your SEO juju.

ChatBot Blocker by CellarWeb

Up in the last 7 days:251#32,740

by Rick Hellewell2 years ago

ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

RRZE-Robots-Txt

#43,543

by rvdforst13 years ago

Ermöglich die Bearbeitung des robots.txt Inhalts um weitere Direktiven hinzuzufügen. Multisite kompatibel.

Thin Content Manager

Up in the last 7 days:36#47,846

by msfreed12 years ago

See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

Robots.txt Extender

Up in the last 7 days:31#47,903

by bettoadami6 years ago

Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

Noindex paged OrgV

Up in the last 7 days:21,822#48,805

by WebDev Solutions1 year ago

Простой плагин для WordPress, который запрещает поисковым системам индексировать страницы пагинации.

Mwangip AI Crawler and Referral Analytics

Up in the last 7 days:21,808#50,098

by Ceaser mwangi8 days ago

See which AI crawlers visit your site, which pages they request, and how much human traffic AI platforms send. Free, private, no external services.

AutomateIndex

Up in the last 7 days:1,640#51,151

by automateindex2 months ago

Connects WordPress to AutomateIndex for owner-approved AI visibility files and monitoring proof.

SanityAI Visibility Toolkit

Up in the last 7 days:5,022#55,689

by wasimuc3 months ago

See your AI traffic, control AI crawlers, get cited by AI. llms.txt generation, AI bot control, and ChatGPT/Perplexity/Claude referral tracking.

SEARCHEN Discover Readiness

#58,862

by searchennetworks1 month ago

A lightweight Google Discover readiness helper for WordPress publishers.

Spuncin

Down in the last 7 days:10,892#61,005

by spuncin2 months ago

Blocks AI crawlers that collect your content to train models. Search engines and link previews are never touched.

DY LLMs.txt Tool

Up in the last 7 days:1,382#61,747

by dyaylaci3 months ago

Create and manage an llms.txt file for AI crawlers to improve AEO (Answer Engine Optimization) and provide an authoritative AI index for your site.

FacetGuard SEO

Up in the last 7 days:3,604#62,115

by Mateusz Maciejczyk7 months ago

Control faceted and parameter URLs in WooCommerce with safe robots + canonical rules, SEO Check and a dry-run analyzer.

Staging Bot Block

Up in the last 7 days:6,082#62,123

by Jared Pomranky11 months ago

Prevent search engines from indexing staging sites by blocking or redirecting bots, with a clear admin warning banner.