Best crawler plugins for WordPress

NMOS Crawl Tracking

#65,688

by NMOS17 days ago

Install NMOS.NET meta tag, tracking.js, and optional no-JS beacon on your WordPress site.

FacetFence Product Filters

Up in the last 7 days:943#65,841

by Hamidreza Rezaei4 months ago

Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.

ReadyStack Robots Txt AI Crawler Audit

#66,545

by readystack27 days ago

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines.

EZDIGI Tool

Down in the last 7 days:15,586#67,198

by EZDIGI3 days ago

All-in-one management toolkit for WordPress: site security, bot blocker, crawler, image optimizer, variation fixer, affiliate manager, live streaming …

Pixellize Site Issue Scanner

Down in the last 7 days:3,837#67,231

by Pixellize2 months ago

Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.

All-IN Crawler & AI Agent Manager

#67,256

by Eli Shvarzman2 days ago

Allow, rate-limit or block bots, AI crawlers and scrapers, and stay visible to search engines and AI assistants.

Msite AI Crawler Monitor

#67,696

by Kobi Mashiah - Msite28 days ago

See which AI crawlers visit your site and check that your site is technically ready for AI engines. Hebrew and RTL friendly.

Mwangip AI Crawler and Referral Analytics

Up in the last 7 days:4,773#67,847

by Ceaser mwangi8 days ago

See which AI crawlers visit your site, which pages they request, and how much human traffic AI platforms send. Free, private, no external services.

AI Visibility Control

Down in the last 7 days:9,184#69,514

by Techbysh1 month ago

Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.

ADG Markdown for AI Crawlers

Down in the last 7 days:9,363#69,516

by A-Devgroup.com1 month ago

Serve AI crawlers clean Markdown of your content on the same URL, and auto-generate llms.txt / llms-full.txt (with an on-disk fallback).

Softrecs AI Crawler Checker

#70,043

by Alauddin Chowdhury23 days ago

Can GPTBot, ClaudeBot, PerplexityBot and Googlebot reach your site? robots.txt per bot, a live test, a bot visit log and a weekly email alert.

AILYS Lens

Down in the last 7 days:5,915#70,311

by roadleon2 months ago

See how AI reads your site. Detects, verifies, and displays AI crawler visits — all data stays on your own server.

AI Crawler Guard

Down in the last 7 days:8,040#70,986

by aicrawlerguard.com11 months ago

Detect and control AI crawler access with local logging and history.

Content Heal AI Crawler Protection & Honeypot Shield

Down in the last 7 days:2,029#71,689

by piyushsingh1422 days ago

Block unauthorized AI crawlers from scraping your content and monetize verified bot access.

AI Bot Monitor

Down in the last 7 days:21,168#72,323

by straightdigital1 year ago

Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.

URLs Most Wanted for LiteSpeed LScache

#73,530

by imedes4 months ago

A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

LLMAffiliate AI Traffic Monetizer

Down in the last 7 days:11,243#73,772

by llmaffiliate011 month ago

Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.

Raschgroup SEO Suite

#73,985

by Raschgroup2 days ago

Technical SEO, metadata, XML sitemaps, image audits, Search Console opportunities and structured data with optional API-powered analysis.

ddosNull AI Crawler & Scraper Blocker

Down in the last 7 days:1,868#74,010

by ddosnull1 month ago

Block GPTBot, ClaudeBot, Bytespider and 170+ AI crawlers and scrapers, bot by bot. Blocks by user agent and robots.txt. Optional daily list updates.

OtterFixer AI Bot Tracker

Down in the last 7 days:10,173#74,147

by OtterFixer8 months ago

A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.