METHOD OF DETECTING LANDMARKS FOR NAVIGATION OF AUTONOMOUS MOBILE ROBOTS USING FEATURES OF AVERAGE COLOR INTENSITY DISTRIBUTION

Authors

DOI:

https://doi.org/10.20998/2079-0023.2024.02.03

Keywords:

autonomous mobile robot, landmark, parameter jumps, color intensity distribution

Abstract

The use of video cameras in the navigation of autonomous mobile robots is one of the possible ways of implementing passive remote methods of detecting ground landmarks. A method for detecting ground landmarks during the navigation of autonomous mobile robots was proposed, which is based on the features of the distribution of average color intensity in the columns of the video camera matrix of the autonomous mobile robot. The main feature of the distribution is manifested in the fact that when a pillar-like object appears in the field of view of the video camera as a possible landmark, a jump or dip appears in it, the amplitude of which can serve as a criterion for landmark detection. The work shows that this operation can be effectively performed on the basis of the image matrix analysis, if the color of the landmark is significantly different from the color of the background image. In other cases, it is proposed to use the averaging of the intensity of red, green, and blue colors along the columns of the video camera matrix. The specified method to increase the probability of landmark detection in the broad conditions of application of a video camera of an autonomous mobile robot is proposed to use as a detection criterion the product of the modulus of the derivative of the distribution of average colors in the columns of the matrix by the modulus of the difference of the specified distribution and its average value across all columns. It was established that the product of the module of the specified derivative by the module of the difference between the distribution of average colors and the average value of this distribution, which is called the determining product, can serve as a criterion for identifying a landmark. It is shown that exceeding the maximum value of the determining product above the threshold value, which is determined based on the analysis of statistical data, in any of the channels of red, green, and blue colors indicates the detection of a ground landmark. Research data show that the determining product in its influence on the probabilistic characteristics of detection is similar to the signal-to-noise ratio in radar.

Author Biographies

Oleksandr Poliarus, Kharkiv national automobile and highway university

doctor of engineering science, professor, Kharkiv national automobile and highway university, Kharkiv, Ukraine

Yurii Khomenko, Kharkiv national automobile and highway university

graduate student, Kharkiv national automobile and highway university; Kharkiv, Ukraine

References

Poliarus O., Poliakov Y. The Methods of Radar Detection of Landmarks by Mobile Autonomous Robots. Machine Vision and Navigation. 2020, pp. 171–196. DOI: doi.org/10.1007/978-3-030-22587-2_6.

Yang J., Liu L., Li S. Z. Separating specular and diffuse reflection components in the HSI color space. IEEE International Conference on Computer Vision Workshops. 2013, pp. 891–898. DOI: doi.org/10.1007/978-3-030-22587-2_6.

Anouncia S. M., Joseph J. G. Approaches for Automated Object Recognition and Extraction from Images a Study. Journal of Computing and Information Technology. 2009, vol. 17, no. 4, pp. 359–370. DOI: doi.org/10.2498/cit.1001363.

Fukuda T., Ito S., Arai F., Yokoyama Y., Abe Y., Tanaka K., Tanaka Y. Navigation system based on ceiling landmark recognition for autonomous mobile robot-landmark detection based on fuzzy template matching (FTM). 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots. 1995, vol. 2, pp. 150–155. DOI: doi.org/10.1109/iros.1995.526153.

Novak G., Bais A., Mahlknecht S. Simple stereo vision system for real-time object recognition for an autonomous mobile robot. Second IEEE International Conference on Computational Cybernetics. 2004, pp. 213–216. DOI: doi.org/10.1109/ICCCYB.2004.1437710.

Zhengt J. Y., Barth M., Tsuji S. Autonomous Landmark Selection for Route Recognition by A Mobile Robot. Proceedings of the 1991 IEEE International Conference on Robotics and Automation. 1991, vol. 3, pp. 2004–2009. DOI: doi.org/10.1109/robot.1991.131922.

Abdullah Q., Shah N., Mohamad M., Ali M., Farah N., Salh A., Aboali M., Mohamad M., Saif A. Real-time Autonomous Robot for Object Tracking using Vision System. Solid State Technology. 2020, vol. 63, pp. 16278–16294. DOI: doi.org/10.48550/ arXiv.2105.00852.

Poliarus O. V., Poliakov Y. O. Detection of Landmarks by Mobile Autonomous Robots Based on Estimating the Color Parameters of the Surrounding Area. Examining Optoelectronics in Machine Vision and Applications in Industry 4.0. 2021, pp. 224–257. DOI: doi.org/10.4018/978-1-7998-6522-3.ch008.

Thin K., Zaw N. Object Detection System of an Autonomous Mobile Robot by using Artificial Neutral Network. International Journal of Scientific and Research Publications. 2019, vol. 9, pp. 374–380. DOI: doi.org/10.29322/ijsrp.9.03.2019.p8758.

Zhou Z., Li L., Fürsterling A., Durocher H., Mouridsen J., Zhang X. Learning-based object detection and localization for a mobile robot manipulator in SME production. Robotics and Computer-Integrated Manufacturing. 2022, vol. 73, no. 102229, pp. 1–12. DOI: doi.org/10.1016/j.rcim.2021.102229.

Poliarus O., Poliakov Ye., Lebedynskyi A. Detection of landmarks by autonomous mobile robots using camera-based sensors in outdoor environments. IEEE Sensors Journal. 2021, vol. 21, pp. 11443–11450. DOI: doi.org/10.1109/JSEN.2020.3010883.

Kriegel H., Kroger P., Schubert E., Zimek A. Outlier Detection in Arbitrarily Oriented Subspaces. IEEE 12th International Conference on Data Mining. 2012, pp. 379–388. DOI: https://doi.org/10.1109/icdm.2012.21.

Downloads

Published

2025-01-04

How to Cite

Poliarus, O., & Khomenko, Y. (2025). METHOD OF DETECTING LANDMARKS FOR NAVIGATION OF AUTONOMOUS MOBILE ROBOTS USING FEATURES OF AVERAGE COLOR INTENSITY DISTRIBUTION. Bulletin of National Technical University "KhPI". Series: System Analysis, Control and Information Technologies, (2 (12), 18–24. https://doi.org/10.20998/2079-0023.2024.02.03

Issue

No. 2 (12) (2024)

Section

CONTROL IN TECHNICAL SYSTEMS

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

  • Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  • Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  • Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).