googleblog.com

source robots.txt

search-type 9.00/9 · hybrid 6.00/6 · training 10.00/10; strategy tag Unconfigured. Unconfigured examples: OAI-SearchBot, Claude-SearchBot, PerplexityBot.

check id l1.robots.ai-policy

source GET / (transparent AI UA)

transparent UA GET / → 429 (challenge page); content fetched via browser-UA fallback → wall honestly scored 0 for unfamiliar UAs

check id l1.no-tech-wall

source GET /

GET / → 200, full HTML document returned

check id l1.basic-availability

source GET /llms.txt, /llms-full.txt, homepage HTML

llms.txt 200 and non-empty; llms-full.txt 200; homepage has no llms.txt link

check id l2.llms-family

source homepage HTML

JSON-LD blocks ×1; contains key schema.org type; JSON-LD parsable

check id l2.structured-data

source homepage HTML

semantic landmarks 4/4; h1 ×6 (multiple); html[lang] present; body text 1617 words

check id l2.semantic-html

source GET /sitemap.xml + robots.txt

GET /sitemap.xml → HTTP 404; robots.txt does not reference a Sitemap

check id l2.sitemap

source homepage HTML

title "News from Google | Google Product and Te"; meta description 130 chars; no date signal; body text 1617 words

check id l2.content-signals

source openapi probe + homepage HTML

OpenAPI not found; API docs not found; homepage has no docs link

check id l3.public-api

source GET /agents.md, /ai.txt + homepage HTML

agents.md HTTP 429; ai.txt not probed; homepage has no AI info page link

check id l3.agent-instructions

source MCP probe

MCP endpoint found: https://googleblog.com/.well-known/mcp

check id l3.mcp

source homepage HTML heuristics

in-site chat/assistant ✓; no AI search; developer console ✓

check id l3.site-ai-features