200-Domain Experiment Suggests Google and Bing Filter Common Crawl Data for LLMs
Common Crawl allocates crawl priority using monthly domain- and host-level harmonic centrality rather than PageRank, explains Stephen Burns.
Crawling
PRO + Bonus posts on this tag: 19
Controlled PBN Tests Prove DOM Placement Strictly Gates Link Discovery
To isolate where the algorithm prioritizes link discovery, I ran a link placement test across PBN websites last month, reveals Chris Palmer.
GSC 'Marked as Fixed' Button Forces Accelerated Recrawl for Error Patterns
The "Marked as Fixed" button in GSC operates as a direct prioritization lever rather than a passive status update, details John Mueller.
Old SERP Favicons Expose Google's 90-Day Crawl Quarantine for Re-Registered Domains
When a re-registered expired domain fails to index past the homepage, an old favicon appearing in site: searches confirms the domain is trapped in Google's reborn-domain quarantine.