Best robots plugins for WordPress

XML Sitemap & Google News

Down in the last 7 days:1#324

by Rolf Allard van Hagen5 months ago

Take control of your WordPress core XML Sitemap and add a Google News Sitemap.

WP Robots Txt

Up in the last 7 days:4#854

by George Pattichis2 months ago

WP Robots Txt Allows you to edit the content of your robots.txt file.

Virtual Robots.txt

Down in the last 7 days:2#873

by Marios Alexandrou2 months ago

Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.

Head Meta Data

Down in the last 7 days:1#1,705

by Jeff Starr3 months ago

Adds a custom set of <meta> tags to the <head> section of all posts & pages.

Robots.txt Editor

Up in the last 7 days:3#1,915

by Processby5 years ago

Robots.txt for WordPress

Companion Sitemap Generator

Up in the last 7 days:2#2,721

by Papin Schipper6 months ago

Create clean, complete, and up-to-date sitemaps for your WordPress website automatically.

HTTP 410 (Gone) responses

Down in the last 7 days:2#3,271

by Matt Calvert3 months ago

Sends HTTP 410 (Gone) responses for deleted content, telling search engines the page is permanently removed.

noindex SEO

Up in the last 7 days:1#3,963

by ROBOTSTXT.es2 months ago

Control search engine indexing with robots directives using HTML meta tags or HTTP headers.

Noindex Pages

Down in the last 7 days:5#4,755

by radgh10 years ago

Ask search engines not to index individual pages by checking an option in the publish post box.

mypace Custom Meta Robots

Down in the last 7 days:5#4,973

by けい (Kei Nomura)5 years ago

Description: This plugin allows you to edit the meta robots tag at every singular post(posts, pages, custom post types). This is a very simple plugin.

Multipart robots.txt editor

Down in the last 7 days:5#5,179

by Viktor Szépe8 years ago

Customize your site's robots.txt and include remote content to it

Robots.txt rewrite

Down in the last 7 days:13#5,833

by Eugen Bobrowski9 years ago

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Magic robots.txt

Up in the last 7 days:14#6,343

by ABCdatos2 months ago

This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.

Cryptex

Down in the last 7 days:19#7,289

by Andi Dittrich7 months ago

Cryptex transforms plain-text E-Mail-Addresses into Images - automatically - No scrapers. No harvesters. No spambots. That's our goal!

Robots.txt Quick Editor

Up in the last 7 days:51#7,374

by davide.airaghi3 years ago

Plugin to edit robots.txt file

Admin Robots.txt Editor

Down in the last 7 days:1#7,578

by Karan Makani2 months ago

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

Noindex Attachment Pages

Up in the last 7 days:9#8,072

by jruizcantero13 years ago

Add META ROBOTS NOINDEX to Attachment Pages in WordPress for better SEO

Search engines blocked warning

Down in the last 7 days:16#9,097

by apasionados9 months ago

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

Block Archive.org via WordPress robots.txt

Up in the last 7 days:50#9,424

by apasionados9 months ago

Blocks the archive.org bots through the WordPress virtual robots.txt file.

Robots & Sitemap

Up in the last 7 days:20#9,573

by Vo3da team5 years ago

Plugin allows easily generate sitemap.xml filе, create and edit robots.txt for your single site or multisite

Bisteinoff SEO Robots.txt

Down in the last 7 days:49#9,668

by Denis Bisteinov10 months ago

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

Disable WP Robots

Down in the last 7 days:34#11,396

by Jeff Starr4 days ago

Disables the robots meta tag added by WordPress.

Crawler Record

Up in the last 7 days:104#16,082

by dizzysoft1 month ago

Crawler Record tells you the last time each of the most common search/LLM chatbots visited (Google, ChatGPT, etc) and the pages at which they looked.

Robots Meta Whiz

Up in the last 7 days:41#16,411

by Marat Nepomnyashy9 years ago

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

Block eCommerce Assets via robots.txt

#16,818

by apasionados3 years ago

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Block Chat GPT via robots.txt

Down in the last 7 days:162#16,865

by apasionados3 years ago

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

410 Delete Pages SEO

Up in the last 7 days:35#17,002

by edsteep6 years ago

Force 410 HTTP Status on listed pages, or just articles/pages that no longer exist.

Noindex by Path

Up in the last 7 days:21#19,757

by Marcin Kijak9 years ago

Ask search engines not to index individual pages by a relative path - which means you can set every url no matter it is a page, category listing or an …

Unblock CSS & JS for Googlebot

Down in the last 7 days:442#21,227

by Miina Sikk10 years ago

Modifies robots.txt to allow Googlebot access JS and CSS files.

TDMRep

Down in the last 7 days:92#21,282

by Pierre Viéville2 years ago

TDM Reservation Protocol. Control how bots and artificial intelligences like ChatGPT, GoogleBot and Bard access your content.

CeeWP Robots.txt Manager

Down in the last 7 days:352#21,899

by CeeWP1 year ago

Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

Block Feed and Comments via robots.txt

Down in the last 7 days:528#27,078

by apasionados3 years ago

Blocks some Feed and Comment resources in order to avoid spam bots

Block Common Crawl via robots.txt

Down in the last 7 days:197#27,850

by apasionados3 years ago

Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

WP Robots Log

#29,598

by Arefly12 years ago

Log the Search Engine Robots Visits of your Webite. 取得搜索引擎的蜘蛛訪問網站的記錄

Seo Crawlytics Data Export & Delete

#29,675

by apasionados3 years ago

Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

U&AI SEO Bridge

Up in the last 7 days:90#31,309

by ybriki2 months ago

Writes SEO title, meta description, canonical, robots and JSON-LD into fields WordPress themes actually render, via a small REST namespace.

Robots “noindex,follow” meta tag

Down in the last 7 days:1,361#32,867

by rodhomor8 years ago

Add robots "noindex,follow" meta tags to archives, tag pages and category pages in order to preserve your SEO juju.

ChatBot Blocker by CellarWeb

Down in the last 7 days:440#33,282

by Rick Hellewell2 years ago

ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

RRZE-Robots-Txt

#40,259

by rvdforst13 years ago

Ermöglich die Bearbeitung des robots.txt Inhalts um weitere Direktiven hinzuzufügen. Multisite kompatibel.

Thin Content Manager

Down in the last 7 days:4,170#45,108

by msfreed12 years ago

See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

Robots.txt Extender

Up in the last 7 days:1,959#46,350

by bettoadami6 years ago

Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

Spuncin

Down in the last 7 days:57#50,404

by spuncin2 months ago

Blocks AI crawlers that collect your content to train models. Search engines and link previews are never touched.

AI Readiness Advisor

Up in the last 7 days:1,943#55,112

by BMoore1 year ago

Audit AI bot access: logs, verification table, robots.txt viewer, quick test, server snippets, and a public REST ping endpoint.

Engineo

Up in the last 7 days:16,512#56,393

by justnaveenthings1 year ago

All-engine optimization plugin (SEO + GEO + AEO) with Elementor compatibility. Optimize for search engines, local search, and AI engines.

ReadyStack Robots Txt AI Crawler Audit

Up in the last 7 days:252#57,647

by readystack26 days ago

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines.

DY LLMs.txt Tool

Up in the last 7 days:1,382#61,747

by dyaylaci3 months ago

Create and manage an llms.txt file for AI crawlers to improve AEO (Answer Engine Optimization) and provide an authoritative AI index for your site.

MetaWise SEO

#63,284

by Iftakharul Islam4 days ago

Adds meta descriptions, Open Graph and Twitter card tags, per-post robots controls, and an XML sitemap.

SEARCHEN Discover Readiness

#63,885

by searchennetworks1 month ago

A lightweight Google Discover readiness helper for WordPress publishers.

SanityAI Visibility Toolkit

Down in the last 7 days:9,371#64,009

by wasimuc3 months ago

See your AI traffic, control AI crawlers, get cited by AI. llms.txt generation, AI bot control, and ChatGPT/Perplexity/Claude referral tracking.

Mwangip AI Crawler and Referral Analytics

#64,085

by Ceaser mwangi7 days ago

See which AI crawlers visit your site, which pages they request, and how much human traffic AI platforms send. Free, private, no external services.