Home › Directory › Agent Standards & Specs › robots.txt (RFC 9309)
robots.txt (RFC 9309)
The Robots Exclusion Protocol standard.
Visit robots.txt (RFC 9309)Docs
| Category | Agent Standards & Specs |
|---|---|
| Authentication | No auth |
| Pricing | Free |
| Website | https://www.rfc-editor.org/rfc/rfc9309 |
| Docs | https://www.rfc-editor.org/rfc/rfc9309 |
| Last checked | 2026-10-14 |
| As JSON | /api/v1/directory/robotstxt-rfc-9309.json |
Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with robots.txt (RFC 9309). Suggest a correction.