Topic
AEO
6articles about AEO.
How to Optimize Content for Claude Search: Breaking Down Anthropic's Retrieval Pipeline
How Claude Search works: Brave Search indexing, BM25 term weighting, dense vector embeddings, and structuring self-contextualizing passages.
Well-Known URIs in Production: Deploying security.txt and A2A agent-card.json
Deploy RFC 8615 /.well-known/ endpoints without silent CDN failures. Covers RFC 9116 security.txt, A2A agent-card.json, and MCP routing.
Robots.txt and AI Crawlers: Which Bots Follow It, Which Ignore It (12 Failures)
A 403 on /robots.txt grants AI crawlers full access. Covers a two-minute diagnostic, 12 silent production failures to fix, and bot behavior auditing.
What Is llms.txt? How It Works, What It Does, and Whether You Need It
What the llms.txt proposal defines, what it leaves to AI consumers, and how to evaluate whether your site needs a curated Markdown entry point.
Structuring for AI Crawlers: What Actually Works, and What llms.txt Doesn't Prove
A 300,000-domain study found llms.txt doesn't predict AI citation. What actually works: semantic HTML, structured data, and self-contained passages.
Data Table Serialization: Semantic HTML for LLM Ingestion
CSS Grid pseudo-tables flatten into ambiguous text in raw scrapers. Semantic table elements preserve row-column relationships for AI retrieval.