Training of Neural Network-Based Cascade Classifiers
- 作者: Teplyakov L.1, Gladilin S.1, Shvets E.1, Nikolaev D.1
-
隶属关系:
- Institute for Information Transmission Problems, Russian Academy of Sciences
- 期: 卷 64, 编号 8 (2019)
- 页面: 846-853
- 栏目: Mathematical Models and Computational Methods
- URL: https://journals.rcsi.science/1064-2269/article/view/201049
- DOI: https://doi.org/10.1134/S1064226919080254
- ID: 201049
如何引用文章
详细
Abstract—Deep Artificial Neural Networks (ANNs) achieve state-of-art performance in many computer vision tasks; however, their applicability in the industry is significantly hindered by their high computational complexity. In this paper we propose a model of ANN classifier with cascade architecture, which allows to lower the average computational complexity of the system by classifying simple input samples without performing full volume of calculations. We propose a method for joint optimization of all ANNs of the cascade. We introduce joint loss function that contains a term responsible for the complexity of the model and allows to control the ratio of the precision and speed of the resulting system. We train the model on CIFAR-10 dataset with the proposed method and show that the resulting model is a Pareto improvement (regarding to speed and precision) compared to the model trained in a traditional way.
作者简介
L. Teplyakov
Institute for Information Transmission Problems, Russian Academy of Sciences
编辑信件的主要联系方式.
Email: teplyakov@iitp.ru
俄罗斯联邦, Moscow, 127051
S. Gladilin
Institute for Information Transmission Problems, Russian Academy of Sciences
编辑信件的主要联系方式.
Email: gladilin@iitp.ru
俄罗斯联邦, Moscow, 127051
E. Shvets
Institute for Information Transmission Problems, Russian Academy of Sciences
编辑信件的主要联系方式.
Email: shvets@iitp.ru
俄罗斯联邦, Moscow, 127051
D. Nikolaev
Institute for Information Transmission Problems, Russian Academy of Sciences
编辑信件的主要联系方式.
Email: dimonstr@iitp.ru
俄罗斯联邦, Moscow, 127051