Multi-Contextual and Multi-Aspect Analysis for Road Surface Type Classification Through Inertial Sensors and Deep Learning
Resumo
The demand for a variety of situational data from the traffic environment and its participants has intensified with the development of applications in Intelligent Transport Systems (ITS). Among these data, the road surface type classification is one of the most important and can be used in the entire ITS domain. For its widespread application, it is necessary to employ a robust technology for the generation of raw data and to develop of a reliable and stable model to process these data in order to produce the classification. The developed model must operate correctly in different vehicles, under different driving styles and in different environments in which a vehicle can travel. In this work we employ inertial sensors, represented by accelerometers and gyroscopes, which are a safe, non-polluting, and low-cost alternative, ideal for large-scale use. We collect nine datasets with contextual variations, including three different vehicles, with three different drivers, in three different environments, in which there are three different road surface types, in addition to variations in the conservation state and presence of anomalies and obstacles such as potholes and speed bumps. After data collection, these data were used in experiments to evaluate various aspects, such as the influence of the vehicle data collection point, the analysis domain, the model input features, and the data window. Afterwards we evaluated the learning and generalization capacity of the models for unknown contexts. In a third step, the data were used in three Deep Neural Network (DNN) models: LSTM-based, GRU-based, and CNN-based. Through a multiaspect and multi-contextual analysis, we considered the CNNbased model as the best one, which obtained an average accuracy between the data collection placements of 94.27% for learning and 92.70% for validation, classifying the road surface between asphalt, cobblestone or dirt road segments.
Referências
T. V. Mathew Transportation systems engineering: Intrusive technologies 2014.
Transportation systems engineering: Nonintrusive technologies 2014 [online] Available: https://nptel.ac.in/courses/105101008/downloads/cete10.pdf.
B. Singh and A. Gupta "Recent trends in intelligent transportation systems: a review" Journal of Transport Literature vol. 9 pp. 30-34 2015.
J. Menegazzo and A. Von Wangenheim Vehicular perception and proprioception based on inertial sensing: a systematic review vol. 10 2018.
J. Menegazzo and A. von Wangenheim "Vehicular perception based on inertial sensing: A structured mapping of approaches and methods" SN Computer Science vol. 1 no. 5 aug 2020.
A. Bystrov E. Hoare T.-Y. Tran N. Clarke M. Gashinova and M. Cherniakov "Road surface classification using automotive ultrasonic sensor" 2016 proceedings of the 30th anniversary Eurosensors Conference - Eurosensors 2016 vol. 168 pp. 19-22 4–7. Sepember 2016.
D. Nemec M. Hruboš R. Pirník A. Janota V. Šimák and T. Mravec "Classification of the road infrastructure objects based on mobile two-dimensional laser scanning" 2016 ELEKTRO pp. 450-455 2016.
A. Bystrov M. Abbas E. Hoare T. Tran N. Clarke M. Gashinova et al. "Analysis of classification algorithms applied to road surface recognition" 2015 IEEE Radar Conference (RadarCon) pp. 0907-0911 2015.
M. Nolte N. Kister and M. Maurer "Assessment of deep convolutional neural networks for road surface classification" 2018 21st International Conference on Intelligent Transportation Systems (ITSC) pp. 381-386 2018.
T. Rateke K. A. Justen and A. von Wangenheim "Road surface classification with images captured from low-cost camera-road traversing knowledge (rtk) dataset" Revista de Informática Teórica e Aplicada vol. 26 no. 3 pp. 50-64 2019.
S. Khaleghian and S. Taheri "Terrain classification using intelligent tire" Journal of Terramechanics vol. 71 pp. 15-24 2017.
B. Sebastian and P. Ben-Tzvi "Support vector machine based real-time terrain estimation for tracked robots" Mechatronics vol. 62 2019.
R. Tolentino-Rabelo and D. M. Muñoz "Online terrain classification for mobile robots using fpgas" 2016 IEEE 7th Latin American Symposium on Circuits Systems (LASCAS) pp. 231-234 2016.
V. M. Souza "Asphalt pavement classification using smartphone accelerometer and complexity invariant distance" Engineering Applications of Artificial Intelligence vol. 74 pp. 198-211 2018.
S. Wang S. Kodagoda L. Shi and X. Dai "Two-stage road terrain identification approach for land vehicles using feature-based and markov random field algorithm" IEEE Intelligent Systems vol. 33 no. 1 pp. 29-39 2018.
S. Wang S. Kodagoda L. Shi and H. Wang "Road-terrain classification for land vehicles: Employing an acceleration-based approach" IEEE Vehicular Technology Magazine vol. 12 no. 3 pp. 34-41 2017.
N. Braga Manual de Mecatrônica. Editora NCB 2017.
P. Groves Principles of GNSS Inertial and Multisensor Integrated Navigation Systems Artech House 2013.
G. A. Kumar A. S. Kumar A. A. Kumar and T. Maharajothi "Road quality management system using mobile sensors" 2017 International Conference on Innovations in Information Embedded and Communication Systems (ICIIECS) pp. 1-6 March 2017.
T. Wickramarathne V. Garg and P. Bauer "On the use of 3-d accelerometers for road quality assessment" 2018 IEEE 87th Vehicular Technology Conference (VTC Spring) pp. 1-5 June 2018.
D. Al-Yafeai T. Darabseh and A. I. Mourad "Quarter vs. half car model energy harvesting systems" 2019 Advances in Science and Engineering Technology International Conferences (ASET) pp. 1-5 March 2019.
R. Brunauer and K. Rehrl "Supporting road maintenance with in-vehicle data: Results from a field trial on road surface condition monitoring" 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) pp. 2236-2241 Nov 2016.
V. Douangphachanh and H. Oneyama "Estimation of road roughness condition from smartphones under realistic settings" 2013 13th International Conference on ITS Telecommunications (ITST) pp. 433-439 Nov 2013.
L. B. Gueta and A. Sato "Classifying road surface conditions using vibration signals" 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) pp. 039-043 Dec 2017.
L. C. Lima V. J. P. Amorim I. M. Pereira F. N. Ribeiro and R. A. R. Oliveira "Using crowdsourcing techniques and mobile devices for asphaltic pavement quality recognition" 2016 VI Brazilian Symposium on Computing Systems Engineering (SBESC) pp. 144-149 Nov 2016.
H. P. M. and V. P. Gopi "Vehicle vibration signal processing for road surface monitoring" IEEE Sensors Journal vol. 17 no. 16 pp. 5192-5197 Aug 2017.
R. Nalavde and A. Surve "Driver assistant services using ubiquitous smartphone" 2015 International Conference on Communications and Signal Processing (ICCSP) pp. 0430-0434 April 2015.
G. Singh D. Bansal S. Sofat and N. Aggarwal "Smart patrolling: An efficient road surface monitoring using smartphone sensors and crowdsourcing" Pervasive and Mobile Computing vol. 40 pp. 71-88 2017.
H. X. Tan N. N. Aung J. Tian M. C. H. Chua and Y. O. Yang "Time series classification using a modified lstm approach from accelerometer-based data: A comparative study for gait cycle detection" Gait and Posture vol. 74 pp. 128-134 2019.
Y. LeCun Y. Bengio and G. Hinton "Deep learning" nature vol. 521 no. 7553 pp. 436 2015.
I. Goodfellow Y. Bengio and A. Courville Deep Learning ser. Adaptive Computation and Machine Learning series MIT Press 2016.
G. Zaccone M. Karim and A. Menshawy Deep Learning with Tensor-Flow Packt Publishing 2017.
M. T. Jones Arquiteturas de aprendizado profundo: O surgimento da inteligência artificial Oct 2017.
T. Zebin M. Sperrin N. Peek and A. J. Casson "Human activity recognition from inertial sensor time-series using batch normalized deep lstm recurrent networks" 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) pp. 1-4 2018.
R. Kumar and U. Wiil Recent Advances in Computational Intelligence ser. Studies in Computational Intelligence Springer International Publishing 2019.
P. Dixon K. Schütte B. Vanwanseele J. Jacobs J. Dennerlein J. Schiffman et al. "Machine learning algorithms can classify outdoor terrain types during running using accelerometry data" Gait and Posture vol. 74 pp. 176-181 2019.
J. Wang Y. Chen S. Hao X. Peng and L. Hu "Deep learning for sensor-based activity recognition: A survey" Pattern Recognition Letters vol. 119 pp. 3-11 2019.
J. Yang K. Cheng J. Chen B. Zhou and Q. Li "Smartphones based online activity recognition for indoor localization using deep convolutional neural network" 2018 Ubiquitous Positioning Indoor Navigation and Location-Based Services (UPINLBS) pp. 1-7 2018.
