Skip to content
ATDbbeta
Google May Expand Unsupported Robots.txt Rules List via @sejournal, @MattGSouthern

Google May Expand Unsupported Robots.txt Rules List via @sejournal, @MattGSouthern

Articlesearchenginejournal.com

Google may expand its unsupported robots.txt rules list using HTTP Archive data and could broaden how it handles common misspellings of disallow. The post Google May Expand Unsupported Robots.txt Rules List appeared first on Search Engine Journal.

Last updated Apr 23, 2026 by ATDb automated enrichment

Source
Search Engine Journal
Published
Apr 23, 2026
Topic
Google
Mentions
1

Loading relationships...