| Presentation | 2024-03-15 Exploring Uniform Convergence in Neural Networks and its Implication on Generalization Error Zong Xianzhe, Hiroshi Tamura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Uniform Convergence, a well-established framework for evaluating generalization in traditional Machine Learning, frequently exhibits a gap between its theoretical predictions and the actual outcomes observed in Deep Learning model assessments. In this study, we conducted an experiment and analyzed the generalization errors of models. The observed discrepancies appear to stem from the inherent limitations in the definition of Uniform Convergence’s upper bounds, coupled with the complex nature of Deep Neural Networks. This paper seeks to explore this issue in depth, providing fresh perspectives on model evaluation within the realm of Deep Learning. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Neural NetworksDeep LearningUniform Convergence |
| Paper # | CAS2023-135,CS2023-128 |
| Date of Issue | 2024-03-07 (CAS, CS) |
| Conference Information | |
| Committee | CAS / CS |
|---|---|
| Conference Date | 2024/3/14(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Network processor, Signal processing and circuits for communications, Wireless LAN / PAN, etc. |
| Chair | Yasutoshi Aibara(OmniVision) / Daisuke Umehara(Kyoto Inst. of Tech.) |
| Vice Chair | Norihiko Shinomiya(Soka Univ.) / Seiji Kozaki(Mitsubishi Electric) |
| Secretary | Norihiko Shinomiya(Soka Univ.) / Seiji Kozaki(Renesas Electronics) |
| Assistant | Nao Ito(NIT, Toyama college) / Motoi Yamaguchi(TECHNOPRO) / Shinji Shimoda(Sony Semiconductor Solutions) / Shunsuke Koshita(Hachinohe Inst. of Tech.) / Hikaru Kawasaki(NICT) / Takeshi Suehiro(Mitsubishi Electric) |
| Paper Information | |
| Registration To | Technical Committee on Circuits and Systems / Technical Committee on Communication Systems |
|---|---|
| Language | ENG-JTITLE |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Exploring Uniform Convergence in Neural Networks and its Implication on Generalization Error |
| Sub Title (in English) | |
| Keyword(1) | Neural NetworksDeep LearningUniform Convergence |
| 1st Author's Name | Zong Xianzhe |
| 1st Author's Affiliation | CHUO University(CHUO Univ.) |
| 2nd Author's Name | Hiroshi Tamura |
| 2nd Author's Affiliation | CHUO University(CHUO Univ.) |
| Date | 2024-03-15 |
| Paper # | CAS2023-135,CS2023-128 |
| Volume (vol) | vol.123 |
| Number (no) | CAS-438,CS-439 |
| Page | pp.pp.134-139(CAS), pp.134-139(CS), |
| #Pages | 6 |
| Date of Issue | 2024-03-07 (CAS, CS) |