Bump Feature Detection Based on Spectrum Modeling of Discrete-Sampled, Non-Homogeneous Multi-Sensor Stream Data
Source abstract
Abstract
Roads are the most heavily affected aspect of urban infrastructure given the ever-increasing number of vehicles needed to provide mobility to residents, supply them with goods, and help sustain urban growth. An important indicator of degrading road infrastructure is the so-called bump features of the road surface (BFRS), which have affected transportation safety and driving experience. To collect BFRS, we can collect discrete-sampled, non-homogeneous multi-sensor stream data. We propose a BFRS detection method based on spectrum modeling and multi-dimensional features. With the sampling rate of GPS at 1 Hz and a gyroscope and accelerometer at 100 Hz, multi-sensor stream data are recorded at three different urban areas of Nanjing, China, using the smartphone mounted on a vehicle. The recorded stream data captures a geometric feature modeling movement and the respective driving conditions. Derived features also include acceleration, orientation, and speed information. To capture bump features, we develop a deep-learning-based approach based on so-called spectrum features. BFRS detection experiments using multi-sensor stream data from smartphones are conducted, and 4, 14, and 17 BFRS are correctly detected in three different areas, with the precision as 100%, 70.00%, and 77.27%, respectively. Then, comparisons are conducted between the proposed method and three other methods, and the F-score of the proposed method is computed as 1.0000, 0.6363, and 0.7555 at three different areas, which hold the highest value among all results. Finally, it shows that the proposed method performs well in different geographic areas.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Traffic Prediction and Management Techniques · Automated Road and Building Extraction
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Geographic Information Science, School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
Funding
National Natural Science Foundation of China
References (40)
Show source-provided references
1. Real-time GIS for smart cities10.1080/13658816.2019.1673397 ↗
2. Analytics of location-based big data for smart cities: Opportunities, challenges, and future directions10.1016/j.compenvurbsys.2021.101712 ↗
3. Toward a mobile crowdsensing system for road surface assessment10.1016/j.compenvurbsys.2017.12.005 ↗
4. Geomatics for smart cities-concept, key techniques, and applications10.1080/10095020.2013.772803 ↗
5. Simultaneous road surface and centerline extraction from large-scale remote sensing images using CNN-based segmentation and tracing10.1109/TGRS.2020.2991733 ↗
6. Toward crowdsourcing-based road pavement monitoring by mobile sensing technologies10.1109/TITS.2014.2378511 ↗
7. Li, X., Huo, D., Goldberg, D.W., Chu, T., Yin, Z., and Hammond, T. (2019). Embracing crowdsensing: An enhanced mobile sensing solution for road anomaly detection. ISPRS Int. J. Geo-Inf., 8.10.3390/ijgi8090412 ↗
8. MAARGHA: A prototype system for road condition and surface type estimation by fusing multi-sensor data10.3390/ijgi4031225 ↗
9. Dong, D., and Li, Z. (2021). Smartphone sensing of road surface condition and defect detection. Sensors, 21.10.3390/s21165433 ↗
10. Adaboost-based crack detection method for pavement10.1088/1742-6596/1087/2/022005 ↗
11. Computer vision for road imaging and pothole detection: A state-of-the-art review of systems and algorithms10.1093/tse/tdac026 ↗
12. Jenkins, M.D., Carr, T.A., Iglesias, M.I., Buggy, T., and Morison, G. (2018, January 3–7). A deep convolutional neural network for semantic pixel-wise segmentation of road and pavement surface cracks. Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), Rome, Italy.
13. Zhang, Z., Ai, X., Chan, C.K., and Dahnoun, N. (2014, January 4–9). An efficient algorithm for pothole detection using stereo vision. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6853659 ↗
14. Xiao, L., Dai, B., Liu, D., Hu, T., and Wu, T. (July, January 28). CRF based road detection with multi-sensor fusion. Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Republic of Korea.10.1109/IVS.2015.7225685 ↗
15. Pothole detection based on disparity transformation and road surface modeling10.1109/TIP.2019.2933750 ↗
16. A Deep Learning-Based Approach for Road Surface Damage Detection
17. A novel pavement transverse cracks detection model using WT-CNN and STFT-CNN for smartphone data analysis10.1080/10298436.2021.1945056 ↗
18. Siegemund, J., Franke, U., and Förstner, W. (2011, January 5–9). A temporal filter approach for detection and reconstruction of curbs and road surfaces based on conditional random fields. Proceedings of the 2011 IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany.10.1109/IVS.2011.5940447 ↗
19. Kang, B., and Choi, S. (2017, January 4–7). Pothole detection system using 2D LiDAR and camera. Proceedings of the 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN), Milan, Italy.10.1109/ICUFN.2017.7993890 ↗
20. An Overview of Road Health Monitoring System for Rigid Pavement By Terrestrial Laser Scanner10.5194/isprs-archives-XLIII-B1-2022-173-2022 ↗
21. Vehicle vibration signal processing for road surface monitoring10.1109/JSEN.2017.2719865 ↗
22. EcRD: Edge-cloud computing framework for smart road damage detection and warning10.1109/JIOT.2020.3024885 ↗
23. Smart patrolling: An efficient road surface monitoring using smartphone sensors and crowdsourcing10.1016/j.pmcj.2017.06.002 ↗
24. Mednis, A., Strazdins, G., Zviedris, R., Kanonirs, G., and Selavo, L. (2011, January 27–29). Real time pothole detection using android smartphones with accelerometers. Proceedings of the 2011 International Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS), Barcelona, Spain.10.1109/DCOSS.2011.5982206 ↗
25. A participatory sensing framework to classify road surface quality10.1186/s13174-019-0111-1 ↗
26. Xu, C., Zhang, Q., Mei, L., Chang, X., Ye, Z., Wang, J., Ye, L., and Yang, W. (2023). Cross-Attention-Guided Feature Alignment Network for Road Crack Detection. ISPRS Int. J. Geo-Inf., 12.10.3390/ijgi12090382 ↗
27. Automatic pavement crack recognition based on BP neural network10.7307/ptt.v26i1.1477 ↗
28. Azhar, K., Murtaza, F., Yousaf, M.H., and Habib, H.A. (2016, January 15–18). Computer vision based detection and localization of potholes in asphalt pavement images. Proceedings of the 2016 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), Vancouver, BC, Canada.10.1109/CCECE.2016.7726722 ↗
29. Pothole detection on asphalt pavements from 2D-colour pothole images using fuzzy c-means clustering and morphological reconstruction10.1016/j.autcon.2017.08.017 ↗
30. Sharma, S.K., Phan, H., and Lee, J. (2020). An application study on road surface monitoring using DTW based image processing and ultrasonic sensors. Appl. Sci., 10.10.3390/app10134490 ↗
31. Mednis, A., Strazdins, G., Liepins, M., Gordjusins, A., and Selavo, L. (2010, January 7–9). RoadMic: Road surface monitoring using vehicular sensor networks with microphones. Proceedings of the Networked Digital Technologies: Second International Conference, NDT 2010, Prague, Czech Republic. Proceedings, Part II 2.10.1007/978-3-642-14306-9_42 ↗
32. Roadsense: Smartphone application to estimate road conditions using accelerometer and gyroscope10.1109/JSEN.2017.2702739 ↗
33. Mihoub, A., Krichen, M., Alswailim, M., Mahfoudhi, S., and Salah, R.B.H. (2023). Road scanner: A road state scanning approach based on machine learning techniques. Appl. Sci., 13.10.3390/app13020683 ↗
34. Zang, K., Shen, J., Huang, H., Wan, M., and Shi, J. (2018). Assessing and mapping of road surface roughness based on GPS and accelerometer sensors on bicycle-mounted smartphones. Sensors, 18.10.3390/s18030914 ↗
35. A machine learning approach to road surface anomaly assessment using smartphone sensors10.1109/JSEN.2019.2952857 ↗
36. A deep learning approach to automatic road surface monitoring and pothole detection10.1007/s00779-019-01234-z ↗
37. YOLOv5s-M: A deep learning network model for road pavement damage detection from urban street-view imagery
38. Pachori, R.B. (2023). Time-Frequency Analysis Techniques and Their Applications, CRC Press.10.1201/9781003367987 ↗
39. Kim, D.-Y., Lee, H.W., Yu, J., and Park, J.-K. (2024). Application of Convolutional Neural Networks for Classifying Penetration Conditions in GMAW Processes Using STFT of Welding Data. Appl. Sci., 14.10.3390/app14114883 ↗
40. The estimation of the gradient of a density function, with applications in pattern recognition10.1109/TIT.1975.1055330 ↗