# Design of a Dynamic File Bundling System for Large-scale Content Distribution

Select |

Print

Zhang, Song; Carlsson, Niklas; Eager, Derek; Li, Zongpeng; Mahanti, Anirban

2011-07-25

Conference Material

Symposium Model Analysis and Simulation of Computer and Telecommunications Systems (MASCOTS)

Singapore

N/A

Peer-assisted content delivery systems can provide scalable download service for popular files. For mildly popular content, however, these systems are less helpful in offloading servers as the request rate for less popular files may not enable formation of self-sustaining torrents (where the entire content of the file is available among the peers themselves). As there typically is a long tail of mildly popular content, with a high aggregate demand, a large fraction of the file requests must still be handled by servers, and is not off-loadable to peers. Bundling approaches have been proposed where peers are requested to download content which they may not otherwise be interested in order to inflate'' the popularity of less popular files. In this paper, we present the design and implementation of a dynamic bundling system, in which a large number of files may be bundled to form a {\em super bundle}. From this super bundle, smaller individual bundles, consisting of a small set of files, can dynamically be assigned to individual users. Our system has the capability to dynamically adjust the number of downloaders of each file, thus allowing popularity inflation to be optimized according to current file popularities and the desired tradeoff between download times and server resources. The proposed system is evaluated on Planet Lab.

NOTICE: this is the author's version of a work that was accepted for publication in IEEE MASCOTS 2011. The final version will appear in the conference proceedings published by IEEE. Changes resulting from the publishing process, such as editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication.

nicta:4756

Zhang, Song; Carlsson, Niklas; Eager, Derek; Li, Zongpeng; Mahanti, Anirban. Design of a Dynamic File Bundling System for Large-scale Content Distribution. In: Symposium Model Analysis and Simulation of Computer and Telecommunications Systems (MASCOTS); Singapore. 2011-07-25. N/A. http://hdl.handle.net/102.100.100/103586?index=1