| Presentation | 2010-11-19 A resource-efficient method for crawling swarm information in multiple BitTorrent networks Masahiro YOSHIDA, Akihiro NAKAO, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | BitTorrent is one of the most popular P2P le sharing applications in the world. Each BitTorrent network is called a swarm and millions of peers may join multiple swarms. Due to swarm's large network size and complexity, many resources (PC servers, the Internet connection, etc.) are required for measuring all the swarms in the world. For this reason, the existing work is forced to measure only a part of the entire set of swarms, thus, ends up understanding only a part of it. In this paper, we propose a resource-efficient method for crawling multiple BitTorrent swarms by only a limited amount of resources such as a single PC server. In the proposed method, our crawler avoids collecting redundant information of swarms without pressing WAN access links nor expending much processing resources. We also use a number of techniques to efficiently crawl all the participating peers of multiple swarms. We crawl over 4.3 million unique .torrent files, small files that store metadata used in BitTorrent, and 48,000 tracker addresses. We can crawl 4.3 million swarms within an hour. We obtain 24 swarm snapshots and 10 million unique peers in a day. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | P2P / BitTorrent / Network Measurement / Resource-Efficient Measurement |
| Paper # | CQ2010-59 |
| Date of Issue |
| Conference Information | |
| Committee | CQ |
|---|---|
| Conference Date | 2010/11/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Communication Quality (CQ) |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A resource-efficient method for crawling swarm information in multiple BitTorrent networks |
| Sub Title (in English) | |
| Keyword(1) | P2P |
| Keyword(2) | BitTorrent |
| Keyword(3) | Network Measurement |
| Keyword(4) | Resource-Efficient Measurement |
| 1st Author's Name | Masahiro YOSHIDA |
| 1st Author's Affiliation | The University of Tokyo() |
| 2nd Author's Name | Akihiro NAKAO |
| 2nd Author's Affiliation | The University of Tokyo |
| Date | 2010-11-19 |
| Paper # | CQ2010-59 |
| Volume (vol) | vol.110 |
| Number (no) | 287 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |