Crawl budget is the number of pages Googlebot will crawl on your site in a given timeframe. Google allocates this based on your site's authority, server speed, and crawl demand. For small sites under 1,000 pages, it's rarely a concern. For larger sites—especially e-commerce, news, or database-driven platforms—poorly optimized crawl budget means Google wastes time on duplicate pages, faceted navigation, or outdated content while missing your new product pages or critical updates. The core goal is directing bots toward pages that drive traffic and revenue. Common crawl budget drains include paginated archives without proper rel=next/prev signals, infinite scroll implementations that generate endless URL parameters, duplicate content across HTTP/HTTPS or www/non-www versions, and orphaned pages linked from sitemaps but not the main navigation. Soft 404s and redirect chains also burn budget because bots follow each hop. Practical optimization starts with server log analysis. Pull your Google crawl data for 30 days and compare it against your Analytics traffic. If bots are hammering /tag/ pages or old date-based archives that generate zero visits, those are immediate candidates for noindex or removal from XML sitemaps. Consolidate parameters using canonical tags or URL parameter handling in Search Console. Fix redirect chains to single-hop 301s. Use robots.txt strategically to block admin panels, search result pages, and infinite calendar paths. For high-change sites like job boards or inventory-heavy e-commerce, prioritize fresh content by keeping XML sitemaps under 50,000 URLs per file and updating lastmod timestamps accurately. Internal linking structure matters too—pages buried four clicks deep get crawled less frequently than those two clicks from the homepage. At Ottawa SEO, we've seen crawl budget issues cost clients millions in potential impressions when Google ignores new landing pages for weeks. The fix is rarely one thing. It's cleaning up years of technical debt, tightening site architecture, and monitoring crawl stats monthly. For sites under 5,000 pages with stable content, focus elsewhere. For anything larger or dynamic, crawl budget optimization is non-negotiable infrastructure work.