| Presentation | 2023-09-22 A prototype system for interactively combining more than 1000 pieces of table formatted big data and interactively overviewing of it Shinji Furusho, Atsushi Iizawa, Hiroshi Tezuka, Yukio Yamamoto, Takashi Matsuhisa, Manabu Iida, Tadashi Nagao, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The virtual tabular data, created with the purpose of facilitating the distribution of diverse tabular big data, is a virtual and hierarchical combination of actual and virtual tabular data sets on the network. It is designed to cater to specific usage needs and can be immediately generated with minimal memory consumption. Additionally, it features a high-speed and versatile virtual index, utilizing Natural Number Indexing (NNI), across all columns. The network system created from these actual and virtual tabular data sets is referred to as IoD (Internet of Data). Through IoD, save, transfer, and overview of tabular big data can be achieved on a single PC, enabling its distribution. In this study, we combined over 1000 instances of tabular big data on a single PC, generating over 3 trillion virtual tabular data records, and validated its performance. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | tabular big data / virtual tabular big data / virtual index / NNI / IoD |
| Paper # | DE2023-24 |
| Date of Issue | 2023-09-14 (DE) |
| Conference Information | |
| Committee | DE / IPSJ-DBS / IPSJ-IFAT |
|---|---|
| Conference Date | 2023/9/21(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kitakyushu International Conference Center |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Bigdata management, information retrieval, knowledge discovery, etc. |
| Chair | Masashi Toyoda(Univ. of Tokyo) |
| Vice Chair | Kosuke Takano(Kanagawa Inst. of Tech.) / Chiemi Watanabe(Tsukuba Univ. of Technology) |
| Secretary | Kosuke Takano(Univ. of Tsukuba) / Chiemi Watanabe(Komazawa Univ.) |
| Assistant | Takahiro Komamizu(Nagoya Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Data Engineering / Special Interest Group on Database System / Special Interest Group on Information Fundamentals and Access Technologies |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A prototype system for interactively combining more than 1000 pieces of table formatted big data and interactively overviewing of it |
| Sub Title (in English) | Performance measurement of overviewing (displaying, searching, tabulating, and sorting) more than 3 trillion records of virtual table formatted data |
| Keyword(1) | tabular big data |
| Keyword(2) | virtual tabular big data |
| Keyword(3) | virtual index |
| Keyword(4) | NNI |
| Keyword(5) | IoD |
| 1st Author's Name | Shinji Furusho |
| 1st Author's Affiliation | NNI Technologies(NNI Technologies) |
| 2nd Author's Name | Atsushi Iizawa |
| 2nd Author's Affiliation | Ricoh IT Solutions(Ricoh IT Solutions) |
| 3rd Author's Name | Hiroshi Tezuka |
| 3rd Author's Affiliation | Bird's-eye View Engineering Institute(Bird's-eye View Engineering Institute) |
| 4th Author's Name | Yukio Yamamoto |
| 4th Author's Affiliation | Japan Aerospace Exploration Agency(ISAS) |
| 5th Author's Name | Takashi Matsuhisa |
| 5th Author's Affiliation | SEC(SEC) |
| 6th Author's Name | Manabu Iida |
| 6th Author's Affiliation | SEC(SEC) |
| 7th Author's Name | Tadashi Nagao |
| 7th Author's Affiliation | Layman's Admin(Layman's Admin) |
| Date | 2023-09-22 |
| Paper # | DE2023-24 |
| Volume (vol) | vol.123 |
| Number (no) | DE-192 |
| Page | pp.pp.78-83(DE), |
| #Pages | 6 |
| Date of Issue | 2023-09-14 (DE) |