Google Crawl Budget Is Allocated by Hostname
Google gives every hostname its own allocated crawl budget. So that means each domain, subdomain, etc has its own unique crawl budget.
Search Engine Roundtable 1:17 pm on April 15, 2024
Text John Mueller from Google confirmed that each hostname receives its own unique crawl budget, including domains and subdomains. This was discussed in a LinkedIn post where the question related to crawling a page on domain A that loads a resource from domain B (different server).
- Google assigns unique crawl budget to each hostname
- This includes domains and subdomains
- Question raised in LinkedIn post about crawling page on domain A that loads resource from domain B
- John Mueller confirmed they're independent
- Pedro Dias stated it is allocated by hostname, and several subdomains might have their own crawl-rate limits. Gary Illyes from Google also confirmed this statement.
https://www.seroundtable.com/google-allocates-crawl-budget-by-hostname-37224.html