Abstract
A significant fraction of Web data is available only for short periods of time. We consider methods to keep track and to record such dynamic information automatically. The main problems are to find adequate reload times for Web data in order to reduce network traffic, to improve the freshness of obtained data and to reduce the risk of loosing information. Previous approaches usually improve reload strategies for Web data by considering the change dynamics of pages, by modeling the behavior statistically and then by applying suitable reload strategies. Based on this approach we first give a precise definition of data changes on the Web. Page changes are described by a page decomposition which is based on the estimation of grammars. Based on this decomposition segments of Web pages are identified. The change behavior of individual segments is recorded and applied to optimize reload strategies. We show that the completeness of obtained data and the network traffic may be improved significantly by applying our new reload strategy.
Original language | English |
---|---|
Title of host publication | 2008 Third International Conference on Internet and Web Applications and Services |
Number of pages | 10 |
Publisher | IEEE |
Publication date | 01.06.2008 |
Pages | 416-425 |
ISBN (Print) | 978-0-7695-3163-2 |
DOIs | |
Publication status | Published - 01.06.2008 |
Event | 3rd International Conference on Internet and Web Applications and Services - Athens, Greece Duration: 08.06.2008 → 13.06.2008 Conference number: 73382 |