Skip to content
ToolCargo

Docs · Updated 2026-09-11

robots.txt — tool reference

Public hosts only. One file, one path, one user-agent.

Server URL: https://toolcargo.com/mcp/robots-txt · Included with Site Audit.

inspect_robots

input
{ "host": "example.com", "path": "/blog", "user_agent": "Googlebot" }