What is crawl budget and how can I optimize it?

Crawl budget is the number of pages Googlebot is willing and able to crawl within a given timeframe.

Large sites with duplicate pages, parameterized URLs, or infinite loops waste crawl budget, preventing critical pages from being indexed quickly.

To optimize:

• Block unimportant URLs via robots.txt.

• Use canonical tags.

• Fix broken links.

• Improve site speed (faster sites get crawled more).

Efficient crawl budget allocation ensures your most valuable pages are prioritized for indexing.