Fragmentation Of Dynamic Web Pages
ABSTRACT

Redundant data transfers over the web can be mainly attributed to repeated transfers of unchanged data. Web caches and web proxies are some of the solutions that have been proposed, to deal with the issue of redundant data transfers. We focus on the efficient estimation and reduction of redundant data transfers over the web.

Constructing Web pages that change over time such as news or information broadcast websites by observing changes in fragments of the web pages has been shown to provide significant benefits for both content generation and caching. In order for a Web site to use fragment-Constructing Web pages that change over time such as news or information broadcast websites by observing changes in fragments of the web pages has been shown to provide significant benefits for both content generation and caching. In order for a Web site to use fragment-based content generation, however, good methods are needed for fragmenting the Web pages.

Manual fragmentation of Web pages is expensive, error prone, and un-scalable. Web pages are broken down to fragments, based on specific criteria. We then deal with these fragments as independent constructors of the Web page and study their change patterns independently and in the context of the whole Web page.

After the fragmentation process, we propose solutions for dealing with redundant data transfers and ranking fragments in the order they can be sent to clients when a web page is requested. Our work shows the results when the algorithms are applied to real Web sites.