プラグインタグ: crawler
-
GlobeSign Content Markdown Mirror
Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.
-
Trackbase Analytics
Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.
-
Boring Cache Warmup Lite
A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.
-
Crawl Hunt – Advanced SEO Optimization Tool
A powerful website crawler and monitoring tool for WordPress.
-
SEObot Monitor for Googlebot, Bingbot and search engine spiders
With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …
-
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
GoVISIBLE AI Bot Tracker
Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.
-
GoBookMart Robots Editor
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
JaspreetChahal’s wordpress bot detector lite
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …
-
-
BotObservatory – Live Bot Tracker & Anti-Scraper
Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.
-
Virtual LLMS.TXT Generator
Publish a safe, configurable llms.txt map from public WordPress content, with an opt-in bounded full-text export.
-
URLs Most Wanted for LiteSpeed LScache
A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.
-
Imedes AI Bot Verify
Verify supported AI bot identities, allow legitimate agents, and block spoofed claims.
-
Pixellize Site Issue Scanner
Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.
-
Whizz MD — Markdown Endpoints for AI Crawlers
Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.
-
FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots
Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.
-
WEO LLMS & AI Crawler Guide
The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …
-
Cleotic AI Traffic
See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.
