PushRank crawler

Crawler identity

Operator

TECHINS8

Classification

Signed agent (customer-directed SEO audit)

User-Agent

Mozilla/5.0 (compatible; PushRank/1.0)

Purpose

Authenticated PushRank customers start audits of sites they are authorized to analyze. The crawler retrieves public pages on the submitted site to measure technical SEO, content, internal linking, and indexability. It is not a general-purpose search index.

Crawl behavior

• Reads robots.txt and filters discovered URLs according to the applicable Allow and Disallow rules.
• Stays on the submitted site and only follows same-site URLs that are relevant to the requested audit.
• Uses a per-host request delay, reduces its request rate after HTTP 429 responses, and honors valid Retry-After instructions within safe limits.
• Limits the number of pages and the duration of each audit.

Web Bot Auth

PushRank's direct crawler requests use HTTP Message Signatures with an Ed25519 key. Site operators and security providers can verify the signatures against the public key directory below.

Public key directory: https://api.pushrank.io/.well-known/http-message-signatures-directory

Contact and crawl concerns

To report unexpected crawler behavior or request assistance, contact contact@peaklab.fr