Training of Neural Network-Based Cascade Classifiers
- Авторы: Teplyakov L.1, Gladilin S.1, Shvets E.1, Nikolaev D.1
-
Учреждения:
- Institute for Information Transmission Problems, Russian Academy of Sciences
- Выпуск: Том 64, № 8 (2019)
- Страницы: 846-853
- Раздел: Mathematical Models and Computational Methods
- URL: https://journals.rcsi.science/1064-2269/article/view/201049
- DOI: https://doi.org/10.1134/S1064226919080254
- ID: 201049
Цитировать
Аннотация
Abstract—Deep Artificial Neural Networks (ANNs) achieve state-of-art performance in many computer vision tasks; however, their applicability in the industry is significantly hindered by their high computational complexity. In this paper we propose a model of ANN classifier with cascade architecture, which allows to lower the average computational complexity of the system by classifying simple input samples without performing full volume of calculations. We propose a method for joint optimization of all ANNs of the cascade. We introduce joint loss function that contains a term responsible for the complexity of the model and allows to control the ratio of the precision and speed of the resulting system. We train the model on CIFAR-10 dataset with the proposed method and show that the resulting model is a Pareto improvement (regarding to speed and precision) compared to the model trained in a traditional way.
Об авторах
L. Teplyakov
Institute for Information Transmission Problems, Russian Academy of Sciences
Автор, ответственный за переписку.
Email: teplyakov@iitp.ru
Россия, Moscow, 127051
S. Gladilin
Institute for Information Transmission Problems, Russian Academy of Sciences
Автор, ответственный за переписку.
Email: gladilin@iitp.ru
Россия, Moscow, 127051
E. Shvets
Institute for Information Transmission Problems, Russian Academy of Sciences
Автор, ответственный за переписку.
Email: shvets@iitp.ru
Россия, Moscow, 127051
D. Nikolaev
Institute for Information Transmission Problems, Russian Academy of Sciences
Автор, ответственный за переписку.
Email: dimonstr@iitp.ru
Россия, Moscow, 127051