Plainwren SEO Audit

This is an on-page SEO and metadata audit run by Plainwren. Someone starts a run on Apify and lists the URLs to check. The audit fetches those URLs (and, if needed, a HEAD request for an Open Graph image). It does not crawl the rest of the site, follow links on the page, or read sitemaps.

Store listing: On-Page SEO & Metadata Audit on Apify.

User agent

Every request uses this user agent:

PlainwrenSEOAudit/1.0 (+https://tools.plainwrenstudio.com/bots/seo-audit/)

robots.txt

The audit reads robots.txt once per host and obeys the rules for the token PlainwrenSEOAudit. A 4xx response (other than 429) is treated as no rules. A 429 or 5xx response means that host is not requested for the rest of the run. Crawl-delay is honoured up to 10 seconds.

To opt out, add rules like this to your robots.txt:

User-agent: PlainwrenSEOAudit
Disallow: /

How often it requests

It sends at most one request at a time to a given host, with a default gap of one request per second (the person who starts the run can set 0.2 to 4). Up to four hosts are contacted at once by default, and never more than ten.

Questions or opt-out

Email support@plainwrenstudio.com if you have questions or want to opt out.