Monitoring road pavement deformations by ICP-based stereophotogrammetric method

Introduction. Regular road surface monitoring is essential for an objective assessment of road conditions and timely intervention to combat emerging deformations. Traditional survey methods have long been limited to visual inspection, while developing pavement microcracks could remain undetected for a long time, subsequently leading to significant repair costs. A pressing issue is the development of a road surface monitoring methodology that can detect changes in road surface geometry, including microrelief analysis.

Methods and Materials. In modern practice, a detailed assessment of road surface conditions uses a three-dimensional representation of the surface as an array of laser reflection points obtained by terrestrial and mobile laser scanning. Road surface changes, including deformations, can be monitored and assessed by comparing point clouds obtained using stereophotogrammetry at different times. This requires minimizing the influence of external orientation errors on the clouds obtained at different times by aligning them with each other. A prototype equipped with a full-frame digital camera and a GNSS geodetic receiver was used. Between surveys conducted along two routes approximately one hour apart, changes in the asphalt surface during the specified time were simulated using specialized monitoring mockups to ensure that the survey data reflected both actual pavement deformations and simulated changes. The resulting point clouds contained over 40 million points each. To optimize the analysis, they were thinned to a density of 5 mm and cropped at the boundaries of the study area. The coordinates of the image projection centers were determined in RTK mode. The thinned point clouds were imported into Cloud Compare software (ENST, France) for analysis.

Results. For the study, photogrammetric models of the surveys were constructed, with point clouds superimposed on one another using exterior orientation parameters. The analysis revealed deviations that made it impossible to align the point cloud superposition results. Using the ICP algorithm, a reanalysis of the point clouds was performed after mutual orientation, shifting the second cloud relative to the first using a stable contour. Models placed after the initial survey showed actual changes. It was established that the accuracy of cloud construction based on the original exterior orientation parameters of the images was insufficient, and after integrating the point clouds using ICP algorithms, display improvements were evident.

Discussion and Conclusion. Photogrammetric survey systems exist that are relatively simple to use and relatively inexpensive, as exemplified by the presented model. It has been established that using only the coordinates of projection centers obtained using GNSS measurements as the initial data will result in insufficient point cloud orientation accuracy, specifically for deformation monitoring. However, the system is simple in design, and using modern ICP algorithms, it is possible to align two different time-lapse images, achieving millimeter-level accuracy in deformation changes. These images can be used to detect dynamic road cracks and predict road surface changes. This system, as a relatively inexpensive and simple piece of equipment, can be used for municipal needs, as well as for assessing deformations in specific areas (such as utility punctures or projectile impacts on road sections), to facilitate rapid response.

1. Timofeev E.N., Sevostyanov A.A., Sokolnikov A.V. Creation of a Digital Model of a Railway Track Using Unmanned Aerial Vehicles.Bulletin of the Siberian State University of Railway Engineering. 2024. No. 1 (68). Pp. 73-82. (in Russ.) https://doi.org/10.52170/1815-9265_2024_68_73

2. Altyntseva M.A., Komissarov A.V., Altyntsev M.A. Automated Segmentation and Classification of Mobile Laser Scanning Data for Vectorization of the Contour Part of the Topographic Plan of an Urban Territory. Bulletin of SSUGiT (Siberian State University of Geosystems and Technologies). 2024. Vol. 29, No. 6. Pp. 32-43. (in Russ.) https://doi.org/10.33764/2411-1759-2024-29-6-32-43

3. Vasilenko D.V. Development of an algorithm for classifying dense point clouds using urban development as an example. Bulletin of SSUGiT (Siberian State University of Geosystems and Technologies). 2024. Vol. 29, No. 6. Pp. 44-52. (in Russ.) https://doi.org/10.33764/2411-1759-2024-29-6-44-52

4. Skvaznikov M.A., KolyginD.L. Evaluation of the information content of heterogeneous features of Earth remote sensing objects. Bulletin of SSUGiT (Siberian State University of Geosystems and Technologies). 2024. Vol. 29, No. 5. P. 80-91.(in Russ.)https://doi.org/10.33764/2411-1759-2024-29-5-80-91

5. Ivanov V.G., Kuzina E.I. Gomanov D.E. [et al.] Monitoring terrain changes based on multi-temporal aerospace images using deep learning technologies of neural networks. Geodesy and Cartography. 2025. Vol. 86, No. 5. P. 39-46. (in Russ.) https://doi.org/10.22389/0016-7126-2025-1019-5-39-46

6. Altyntsev M.A. Methodology for integrating mobile laser scanning and aerial photography data to create a digital terrain model. Bulletin of SSUGiT (Siberian State University of Geosystems and Technologies).2022. Vol. 27, No. 5. . 5-18. https://doi.org/10.33764/2411-1759-2022-27-5-5-18

7. Sahebdivani S., Arefi H., Maboudi M. Rail track detection and projection-based 3D modeling from UAV point cloud. Sensors. 2020. Pt. 20, No. 18. Pp. 1-15.

8. Lesiak P. Inspection and maintenance of railway infrastructure with the use of unmanned aerial vehicles. Problemy Kolejnictwa. 2020. No. 188. P. 115-127.

9. Rampriya R.S., Suganya R., Sabari Nathan P. Shunmuga Perumal A comparative assessment of deep neural network models for detecting obstacles in the real time aerial railway track images. Applied Artificial Intelligence. 2022. Pt. 36, No. 1. P. 1-34.

10. Hassan A.T., Fritsch D. Integration of laser scanning and photogrammetry in 3d/4d cultural heritage preservation - a review. International Journal of Applied Science and Technology. 2019. Vol. 9, No. 2. P. 76-91.

11. Rönnholm P., Honkavaara E., Litkey P., Hyyppä H., Hyyppä J. Integration of laser scanning and photogrammetry. ISPRS Workshop on Laser Scanning 2007 and SilviLaser2007. Vol. XXXVI, Part 3; W52, 2007. P. 355-362.

12. Altyntsev M.A. Methodology for integrating terrestrial and airborne laser scanning data. News of higher educational institutions. Geodesy and aerial photography. 2023. Vol. 67, No. 1.P. 26-41. (in Russ.) https://doi.org/10.30533/GiA-2023-007

13. Urso M.G.., Russo G. On the integrated use of laser-scanning and digital photogrammetry applied to an archaeological site. International Archives of ISPRS. 2008. Vol. XXXVII-B5. P. 1107-1112.

14. Han Y., Oh J. Automated geo/co-registration of multi-temporal very-high-resolution imagery. Sensors. 2018. Vol. 18. No. 1599. https://doi.org/10.3390/s18051599

15. Guk A P., Altyntsev M.A. Automatic identification of corresponding points on aerial photographs of forest areas. Bulletin of SGUGiT.2017. Vol. 22, No. 4. P. 68-77.

16. Vasilenko D.V., Permyakov R.V., Classification of photogrammetric point clouds derived from satellite stereo pairs in the PHOTOMOD system for urban planning applications. Geodesy and Cartography. 2025. No. 4. P. 40–47. (in Russ.) https://doi.org/10.22389/0016-7126-2025-1018-4-40-47

17. Thomas H., Tsai Y.-H. H., Barfoot T. D., Zhang J.KPConvX: modernizing kernel point convolution with kernel attention. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024; pp. 5525-5535. https://doi.org/10.1109/CVPR52733.2024.00528

18. Thomas H., Qi C.R., Deschaud J.-E., Marcotegui B., Goulette F., Guibas L.KPConv: flexible and deformable convolution for point clouds. Proceedings of the IEEE International Conference on Computer Vision, 2019; pp. 6410-6419. https://doi.org/10.1109/iccv.2019.00651

19. Shcherbakov V.V. Study of the mobile laser scanner “Scanput” in determining the geospatial position of a railway track.Bulletin of SSUGT (Siberian State University of Geosystems and Technologies). 2020. Vol. 25, No. 2. Pp. 98-108.(in Russ.) https://doi.org/10.33764/2411-1759-2020-25-2-98-108

20. Shcherbakov V.V., Buntsev I.A., Shcherbakov I.V. [et al.]. Mobile laser scanning system for railways and highways. Bulletin of the Siberian State Transport University. 2024. No. 5 (72). Pp. 106-115. (in Russ.) https://doi.org/10.52170/1815-9265_2024_72_106

21. Nekhin S.S., Rubenok A.N., Babashkin N.M., Kovrov A.A. Technical regulation of laser scanning processes. Geodesy and cartography. 2025. Vol. 86, No. 10. Pp. 45-54. (in Russ.) https://doi.org/10.22389/0016-7126-2025-1024-10-45-54

22. Zorina V.V., Entin A.L., Kuramagomedov B.M. Accuracy assessment of coregistration results of high spatial resolution digital surface models.Geodesy and cartography. 2025. Vol. 86, No. 11. Pp. 17-26. (in Russ.) https://doi.org/10.22389/0016-7126-2025-1025-11-17-26

23. Kharchenko S.V. Method of coregistration of digital elevation models to obtain a hydrologically correct representation of the earth’s surface. Geomorphology and paleogeography.2023. Vol. 54. No. 3. Pp. 150-154.(in Russ.)

24. Fedorovsky A.A., Bykov L.V. Influence of survey network configuration parameters on the accuracy of terrestrial stereophotogrammetric survey with direct spatial referencing. News of higher educational institutions. Geodesy and aerial photography. 2024. Vol. 68, No. 2. Pp. 17-29. (in Russ.) https://doi.org/10.30533/GiA-2024-009

25. Altynov A.E., Mohammad A. Study of the influence of variations in the navigation parameters of the survey system (aerial photography, laser scanner) on the accuracy of creating a digital terrain model using simulation modeling. Advances in modern natural science. 2022. No. 5. Pp. 110-120.https://doi.org/10.17513/use.37833

26. Slocum R.K., Parrish C.E. Simulated imag-ery rendering workflow for UAS-based photogram-metric 3D reconstruction accuracy assessments. Re-mote Sensing. 2017. Vol. 9.No. 4. P. 1-19. https://doi.org/10.3390/rs9040396