WebCrawler.php Table of Contents Classes WebCrawlerSmall legacy crawler that follows same-domain links through Storage-backed requests.