Tractable near-optimal policies for crawling [Computer Sciences]

The problem of maintaining a local cache of n constantly changing pages arises in multiple mechanisms such as web crawlers and proxy servers. In these, the resources for polling pages for possible updates are typically limited. The goal is to devise a polling and fetching policy that maximizes the utility...

https://ift.tt/2OQDOa8