Computational nanotechnologyComputational nanotechnologyComputational nanotechnology2313-223X2587-9693YUR-VAK38019610.33693/2313-223X-2025-12-4-155-163GEYDZNINFORMATICS AND INFORMATION PROCESSINGИНФОРМАТИКА И ИНФОРМАЦИОННЫЕ ПРОЦЕССЫResearch ArticleOn the applicability of acoustic sensors in the problem of road surface defectsО применимости акустических датчиков в задаче дефектовки дорожного полотнаGorodnichevMikhail G.ГородничевМихаил Геннадьевич
Russian Federation

Cand. Sci. (Eng.), Associate Professor, Dean, Faculty of Information Technology

кандидат технических наук, доцент, декан, факультет «Информационные технологии»

m.g.gorodnichev@mtuci.ruhttps://orcid.org/0000-0002-5802-55133197-7234MkrtchianGrach M.МкртчянГрач Маратович
Russian Federation

senior lecturer, Department of Software Engineering

старший преподаватель, кафедра «Программная инженерия»

g.m.mkrtchyan@mtuci.ruhttps://orcid.org/0000-0002-7102-42088112-8560PolyantsevaKsenia A.ПолянцеваКсения Андреевна
Russian Federation

Cand. Sci. (Eng.), associate professor, Department of Data Mining

кандидат технических наук, доцент, кафедра «Интеллектуальный анализ данных»

k.a.poliantseva@mtuci.ruMoscow Technical University of Communications and Informatics (MTUCI)Московский технический университет связи и информатики (МТУСИ)12122025124Computational nanotechnologyComputational nanotechnology15516302022026Copyright ©; 2025, Yur-VAKCopyright ©; 2025, Юр-ВАК2025Yur-VAKЮр-ВАКhttps://www.urvak.ru/contacts/https://journals.rcsi.science/2313-223X/article/view/380196

The article is devoted to the development and substantiation of a multimodal methodology for non-destructive monitoring of the condition of the road surface based on acoustic data supplemented by visual observations. At the level of feature analysis, the study demonstrates that the spectrograms of signals recorded when driving over smooth and damaged surfaces contain stable differences in the time-frequency structure suitable for automatic classification and mapping of defects. The requirements for the type of microphone (sensitivity, bandwidth over 8 kHz, directivity) and placement conditions (height, distance to the source, shielding objects) are justified. A two-sensor architecture with time synchronization combining stereo video and acoustics is proposed; it is shown that the correlation of modalities increases the reliability of localization and the quality of defect classification in real traffic conditions. Taken together, the presented approach forms the basis for long-term, fault-tolerant monitoring systems for road infrastructure with early detection of risks, even with increased noise levels and reduced visibility.

Статья посвящена разработке и обоснованию мультимодальной методологии неразрушающего мониторинга состояния дорожного покрытия на основе акустических данных, дополняемых визуальными наблюдениями. На уровне анализа признаков исследование демонстрирует, что спектрограммы сигналов, записанных при проезде по гладкому и поврежденному покрытию, содержат устойчивые различия в частотно-временной структуре, пригодные для автоматической классификации и картирования дефектов. Обосновываются требования к типу микрофона (чувствительность, полоса пропускания свыше 8 кГц, направленность) и к условиям размещения (высота, расстояние до источника, экранирующие объекты). Предложена двухсенсорная архитектура с синхронизацией по времени, объединяющая стереовидео и акустику; показано, что корреляция модальностей повышает надежность локализации и качество классификации дефектов в реальных условиях дорожного движения. В совокупности представленный подход формирует основу для долговременных, отказоустойчивых систем мониторинга дорожной инфраструктуры с ранним выявлением рисков даже при повышенном уровне шумов и ухудшенной видимости.

acoustic sensorpavement defectssound wave analysismachine learningroad constructionакустический датчикдефекты дорожного покрытияанализ звуковых волнмашинное обучениедорожное строительствоPolyantseva K.A., Gorodnichev M.G. Neural network approaches in the problems of detecting and classifying roadway defects. In: Processing of the Wave Electronics and its Application in Information and Telecommunication Systems (WECONF). St. Petersburg, 2022. Pp. 1–7. DOI: 10.1109/WECONF55058.2022.9803392.Polyantseva K.A., Gorodnichev M.G. Neural network approaches in the problems of detecting and classifying roadway defects // Processing of the Wave Electronics and its Application in Information and Telecommunication Systems (WECONF). St. Petersburg, 2022. Pp. 1–7. DOI: 10.1109/WECONF55058.2022.9803392.Moseva M.S., Gorodnichev M.G., Polyantseva K.A. et al. Development of a platform for road infrastructure digital certification. In: Processing of the Intelligent Technologies and Electronic Devices in Vehicle and Road Transport Complex (TIRVED). Moscow, Russian Federation, 2021. Pp. 1–8. DOI: 10.1109/TIRVED53476.2021.9639102.Moseva M.S., Gorodnichev M.G., Polyantseva K.A. et al. Development of a platform for road infrastructure digital certification // Processing of the Intelligent Technologies and Electronic Devices in Vehicle and Road Transport Complex (TIRVED). Moscow, Russian Federation, 2021. Pp. 1–8. DOI: 10.1109/TIRVED53476.2021.9639102.Polyantseva K.A. Development of data accumulation algorithms using a stereo pair and detection of road surface defects. Modern High Technologies. 2022. No. 5-1. Pp. 107–112. (In Rus.). DOI 10.17513/snt.39156.Полянцева К.А. Разработка алгоритмов накопления данных посредством стереопары и детектирования дефектов дорожного полотна // Современные наукоемкие технологии. 2022. № 5-1. С. 107–112. DOI: 10.17513/snt.39156.Polyantseva K.A. A high-load platform for aggregation and analysis of unstructured road surface condition data. Industrial Automation. 2022. No. 5. Pp. 32–37. (In Rus.). DOI: 10.25728/avtprom.2022.05.09.Полянцева К.А. Высоконагруженная платформа для агрегации и анализа неструктурированных данных о состоянии дорожного полотна // Автоматизация в промышленности. 2022. № 5. С. 32–37. DOI: 10.25728/avtprom.2022.05.09.Syed S.A., Rashid M., Hussain S., Zahid H. Comparative analysis of CNN and RNN for voice pathology detection. Biomed Res Int. 2021. Vol. 2021. P. 6635964. DOI: 10.1155/2021/6635964.Syed S.A., Rashid M., Hussain S., Zahid H. Comparative analysis of CNN and RNN for voice pathology detection // Biomed Res Int. 2021. Vol. 2021. P. 6635964. DOI: 10.1155/2021/6635964.Yin W., Kann K., Yu M., Schütze H. Comparative study of CNN and RNN for natural language processing. arXiv:1702.01923. 2017. URL: https://arxiv.org/abs/1702.01923 (data of accesses: 20.09.2025).Yin W., Kann K., Yu M., Schütze H. Comparative study of CNN and RNN for natural language processing // arXiv:1702.01923. 2017. URL: https://arxiv.org/abs/1702.01923 (data of accesses: 20.09.2025).Abu Dabous S., Ait Gacem M., Zeiada W. et al. Artificial intelligence applications in pavement infrastructure damage detection with automated three-dimensional imaging: A systematic review. Alexandria Engineering Journal. 2025. Vol. 117. Pp. 510–533. DOI: 10.1016/j.aej.2024.11.081.Abu Dabous S., Ait Gacem M., Zeiada W. et al. Artificial intelligence applications in pavement infrastructure damage detection with automated three-dimensional imaging: A systematic review // Alexandria Engineering Journal. 2025. Vol. 117. Pp. 510–533. DOI: 10.1016/j.aej.2024.11.081.Ali Z. A comprehensive overview and comparative analysis of CNN, RNN-LSTM and transformer. SSRN Electronic Journal. 2024. DOI: 10.2139/ssrn.5175090.Ali Z. A comprehensive overview and comparative analysis of CNN, RNN-LSTM and transformer // SSRN Electronic Journal. 2024. DOI: 10.2139/ssrn.5175090.Zhang X., Huang J., Song E. et al. Design of small MEMS microphone array systems for direction finding of outdoors moving vehicles. Sensors. 2014. Vol. 14. No. 3. Pp. 4384–4398. DOI: 10.3390/s140304384.Zhang X., Huang J., Song E. et al. Design of small MEMS microphone array systems for direction finding of outdoors moving vehicles // Sensors. 2014. Vol. 14. No. 3. Pp. 4384–4398. DOI: 10.3390/s140304384.Jagatheesaperumal S.K., Bibri S.E., Ganesan S. et al. Artificial intelligence for road quality assessment in smart cities: a machine learning approach to acoustic data analysis. Comput. Urban Sci. 2023. Vol. 3. No. 1. P. 28. DOI: 10.1007/s43762-023-00104-y.Jagatheesaperumal S.K., Bibri S.E., Ganesan S. et al. Artificial intelligence for road quality assessment in smart cities: a machine learning approach to acoustic data analysis // Comput. Urban Sci. 2023. Vol. 3. No. 1. P. 28. DOI: 10.1007/s43762-023-00104-y.Brungart D.S., Kordik A.J., Eades C.S., Simpson B.D. The effect of microphone placement on localization accuracy with electronic pass-through earplugs. In: Processing of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. New Paltz, NY, USA, 2003. Pp. 149–152. DOI: 10.1109/ASPAA.2003.1285853.Brungart D.S., Kordik A.J., Eades C.S., Simpson B.D. The effect of microphone placement on localization accuracy with electronic pass-through earplugs // Processing of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. New Paltz, NY, USA, 2003. Pp. 149–152. DOI: 10.1109/ASPAA.2003.1285853.Montes González D., Barrigón Morillas J.M., Rey Gozalo G., Godinho L. Evaluation of exposure to road traffic noise: Effects of microphone height and urban configuration. Environmental Research. 2020. Vol. 191. P. 110055. DOI: 10.1016/j.envres.2020.110055.Montes González D., Barrigón Morillas J.M., Rey Gozalo G., Godinho L. Evaluation of exposure to road traffic noise: Effects of microphone height and urban configuration // Environmental Research. 2020. Vol. 191. P. 110055. DOI: 10.1016/j.envres.2020.110055.Montes González D., Barrigón Morillas J. M., Rey Gozalo G. The influence of microphone location on the results of urban noise measurements. Applied Acoustics. 2015. Vol. 90. Pp. 64–73. DOI: 10.1016/j.apacoust.2014.11.001.Montes González D., Barrigón Morillas J. M., Rey Gozalo G. The influence of microphone location on the results of urban noise measurements // Applied Acoustics. 2015. Vol. 90. Pp. 64–73. DOI: 10.1016/j.apacoust.2014.11.001.Srivastava S., Sharma G. Omnivec: Learning robust representations with cross modal sharing. arXiv:2311.05709. 2023. URL: https://arxiv.org/abs/2311.05709 (data of accesses: 21.09.2025).Srivastava S., Sharma G. Omnivec: Learning robust representations with cross modal sharing // arXiv:2311.05709. 2023. URL: https://arxiv.org/abs/2311.05709 (data of accesses: 21.09.2025).Chen S., Wu Y., Wang C. et al. Beats: Audio pretraining with acoustic tokenizers. arXiv:2212.09058. 2022. URL: https://arxiv.org/abs/2212.09058 (data of accesses: 21.09.2025).Chen S., Wu Y., Wang C. et al. Beats: Audio pretraining with acoustic tokenizers // arXiv:2212.09058. 2022. URL: https://arxiv.org/abs/2212.09058 (data of accesses: 21.09.2025).Mkrtchian G., Polyantseva K. On the use of an acoustic sensor in the tasks of determining defects in the roadway. Systems of Signals Generating and Processing in the Field of on Board Communications. 2024. Vol. 7. No. 1. Pp. 276–280. DOI: 10.1109/IEEECONF60226.2024.10496721.Mkrtchian G., Polyantseva K. On the use of an acoustic sensor in the tasks of determining defects in the roadway // Systems of Signals Generating and Processing in the Field of on Board Communications. 2024. Vol. 7. No. 1. Pp. 276–280. DOI: 10.1109/IEEECONF60226.2024.10496721.