WebCrawler
in package
FinalYes
Small legacy crawler that follows same-domain links through Storage-backed requests.
Included for historical compatibility only. This API is out of support and should not be used in new code.
Tags
Table of Contents
Properties
- $maxDepth : mixed
- $maxDocs : mixed
- $maxTime : mixed
- $errorList : mixed
- $linkList : mixed
- $url : mixed
Methods
- __construct() : mixed
- crawl() : string
- buildURL() : mixed
- crawlURL() : void
Properties
$maxDepth
public
mixed
$maxDepth
= 0
$maxDocs
public
mixed
$maxDocs
= 1
$maxTime
public
mixed
$maxTime
= 0
$errorList
protected
mixed
$errorList
$linkList
protected
mixed
$linkList
$url
protected
mixed
$url
Methods
__construct()
public
__construct(mixed $url) : mixed
Parameters
- $url : mixed
crawl()
public
crawl() : string
Return values
stringbuildURL()
protected
buildURL(mixed $url[, mixed $parentUrl = '' ]) : mixed
Parameters
- $url : mixed
- $parentUrl : mixed = ''
crawlURL()
protected
crawlURL(mixed $url[, mixed $depth = 0 ][, mixed $parentUrl = '' ]) : void
Parameters
- $url : mixed
- $depth : mixed = 0
- $parentUrl : mixed = ''