Salnikov N.N. – CCE Journal

Issue 4 (190), article 3

DOI:https://doi.org/10.15407/kvt190.04.033

Kibern. vyčisl. teh., 2017, Issue 4 (190), pp.

Melnichuk S.V., Dr (Engineering),
Researcher of Dynamic Systems Control Ddepartment
e-mail: sergvik@ukr.net
Gubarev V.F., Professor,
Dr (Engineering), Professor,
Corresponding Member of NAS of Ukraine,
Head of Dynamic Systems Control Department
e-mail: v.f.gubarev@gmail.com
Salnikov N.N., (Engineering),
Senior Researcher of Dynamic Systems Control Department
e-mail: salnikov.nikolai@gmail.com
Space Research Institute National Academy of Sciences of Ukraine
and State Space Agency of Ukraine,
Acad. Glushkov av. 40, 4/1, 03680, Kyiv 187, Ukraine

USING INFORMATION FEATURES IN COMPUTER VISION FOR 3D POSE ESTIMATION IN SPACE

Introduction. Autonomous rendezvous and docking is an important technological capability that enables various spacecraft missions. It requires the real-time relative pose estimation i.e. determination of the position and attitude of a target object relative to a chaser. The usage of techniques based on optical measurement has certain advantages at close range phases of docking.
The purpose of the paper is to create a computer vision system, that estimates position and attitude of the target relative to the chaser. To develop the design of a computer vision system and suited mathematical methods. To use a new learning-based method, which can be implemented for the real-time execution with limited computing power.
Methods. A non-standard approach to solving the problem was used. A combination of image processing techniques, machine learning, decision trees and piecewise linear
approximation of functions were used. The tool of informative features computed by images was essentially used.
Results. A two-stage algorithm, which involves training the computer vision system to recognize the attitude and position of the target in a changing lighting environment was developed. The calculation of the camera parameters was carried out to ensure a given accuracy of the solution of the problem.
Conclusion. It was shown that the informative features can be used to create a high-performance on-board system for estimating relative attitude and position. Implementation of the proposed algorithm allows to create a competitive device for docking in space.
Keywords: autonomous rendezvous, uncooperative pose estimation, model-based pose estimation, vision-based pose estimation, computer vision, decision tree, linear approximation, informative features, image processing, machine learning, identification, relative position and attitude estimation.

Download full text!

REFERENCES

1 Gubarev V.F., et al. Using Vision Systems for Determining the Parameters of Relative Motion of Spacecrafts. Journal of Automation and Information Sciences, 2016. No11. P. 23–39.
https://doi.org/10.1615/JAutomatInfScien.v48.i11.30

2 Shi J.-F., et al. Uncooperative Spacecraft Pose Estimation Using an Infrared Camera During Proximity Operations. AIAA Space 2015 Conference and Exposition. Issue AIAA 2015–4429. 17 pp.

3 Kelsey J.M., et. al. Vision-Based Relative Pose Estimation for Autonomous Rendezvous and Docking. 2006 IEEE Aerospace Conference. 20 pp.
https://doi.org/10.1109/AERO.2006.1655916

4 Zorich V.A. Mathematical Analysis. Part 2. Moskow: Nauka, 1984. 640 p.

5 David, P. et. al. SoftPOSIT: Simultaneous Pose and Correspondence Determination. Interational Journal of Computer Vision. 2004. Vol. 59. I. 3. P. 259–284.

6 Philip N.K., Ananthasayanam M.R. Relative position and attitude estimation and control schemes for the final phase of an autonomous docking mission of spacecraft. Acta Astronautica. 2003. Vol. 52. I. 7. P. 511–522.

7 Shijie et.al. Monocular Vision-based Two-stage Iterative Algorithm for Relative Position and Attitude Estimation of Docking Spacecraft. Chinese Journal of Aeronautics, 2010. Vol. 23. I. 2. P. 204–210.

8 Vassilieva N.S. Content-based image retrieval methods. Programming and Computer Software. 2009. Vol. 35. No 3. P. 158–180.
https://doi.org/10.1134/S0361768809030049

9 Prewitt J.M.S. Object enhancement and extraction. Picture Processing and Psychopictorics, B. Lipkin and A. Rosenfeld. New York: Academic Press. 1970. P. 75–149.

10 Sobel I., Feldman G. A 3×3 isotropic gradient operator for image processing, presented at a talk at the Stanford Artificial. Project in Pattern Classification and Scene Analysis, R. Duda and P. Hart. Eds.: John Wiley & Sons, 1968. P. 271–272.

11 Canny, J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1986. No 8(6). P. 679–698.

12 Arbelaez P., et al. Contour Detection and Hierarchical Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2010. P. 898–916.

13 Bentley J.L. Multidimensional binary search trees used for associative searching. Communications of the ACM. 1975. Vol. 18. I. 9. P. 509–517.

14 Samet H. The Design and Analysis of Spatial Data Structures. 1990. 493 p.

Received 14.06.2017

Issue 185, article 4

DOI:https://doi.org/10.15407/kvt185.03.035

KVT, 2016, Issue 185, pp.35-47

UDC 629.7.05

USING VIDEO IMAGES FOR DETERMINING RELATIVE DISPOSITION OF TWO SPACECRAFTS

Simakov V.A., Gubarev V.F., Salnikov N.N., Melnichuk S.V.

Space Research Institute of the National Academy of Science of Ukraine and State Space Agency of Ukraine, Kyiv, Ukraine

simakovladimir@gmail.com , v.f.gubarev@gmail.com , nikolai.salnikov@gmail.com , sergvik@ukr.net

Introduction. Automatic orbital berthing systems require permanent availability of relative position and attitude of a target spacecraft. In the most general case the only source of information is video filming. Extracting mutual disposition parameters from a video frame is based upon special techniques which can be divided into two large groups: feature-based and model-based. Major difference between them is defined by data structure used for the target description (individual points for feature-based approach vs. rigorous visual model for model-based one). This article is devoted to the research of mathematical problem that appears in considering pose estimation for two orbital spacecraft in the presence of wireframe model of the target when only video filming is available.

The purpose of the article is to construct a model-based method that provides fast and accurate estimation of relative position and attitude of the target spacecraft. We discuss possible drawbacks of direct procedures based on straightforward (pixel-wise) image fitting and propose a subtle algorithm which satisfies formulated conditions.

Results. The algorithm composed of three independent parts (initialization, pose refinement and pose tracking) has been developed and tested on simple initial datum. Initialization stage, responding for rough estimation in the absence of preliminary information, has given relatively poor but quite enough accuracy for the aims of initial approximation. Pose refinement stage which is implemented as iterative procedure based on closeness of neighboring frames demonstrated almost total matching with actual values. Pose tracking (state estimation based on equations of motion) was redundant for our simple example as it could not improve the result provided by pose refinement.

Conclusions. Constructed algorithm has been tested on simplified situation and demonstrated very high precision. More realistic conditions including noises and occlusions can bring to corrupted result that should be recovered. This requires introducing additional steps into the algorithm which are reflected in the text. The notable feature of the algorithm is its high modularity which allows each stage to be implemented and configured independently according to available resources and mission requirements.

Keywords: orbital rendezvous, pose estimation, orbital video filming, computer vision.

Download full text (ru)!

References:

1 Lowe D.G. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 2004, 60 (2), pp. 91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94

2 David P. SoftPOSIT: Simultaneous Pose and Correspondence Determination. International Journal of Computer Vision, 2004, 59 (3), pp. 259–284. https://doi.org/10.1023/B:VISI.0000025800.10423.1f

3 Black M.J., Jepson A.D. EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation. International Journal of Computer Vision, 1998, 26 (1), pp. 63–84. https://doi.org/10.1023/A:1007939232436

4 Trefethen L.N., Bau D. Numerical Linear Algebra. Philadelphia: SIAM, 1997, 361p. https://doi.org/10.1137/1.9780898719574

5 Drummond T., Cipolla R. Real-Time Visual Tracking of Complex Structures. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24 (7), pp. 932–946. https://doi.org/10.1109/TPAMI.2002.1017620

6 Hartley R., Zisserman, A. Multiple View Geometry in Computer Vision. 2nd Edition. Cambridge University Press, 2004, 655p. https://doi.org/10.1017/CBO9780511811685

7 Paterson M.S., Yao, F.F. Efficient Binary Space Partitions for Hidden-Surface Removal and Solid Modeling. Discrete and Computational Geometry, 1990, 5, pp. 485–503. https://doi.org/10.1007/BF02187806

8 Kelsey J.M., et. al. Vision-Based Relative Pose Estimation for Autonomous Rendezvous and Docking. 2006 IEEE Aerospace Conference. — 20 p. https://doi.org/10.1109/AERO.2006.1655916

9 Wenfu X., et al. Autonomous Rendezvous and Robotic Capturing of Non-Cooperative Target in Space. Robotica, 2010, 28, pp. 705–718. https://doi.org/10.1017/S0263574709990397

10 Fehse W. Automated Rendezvous and Docking of Spacecraft. Cambridge University Press, 2003, 495 p. https://doi.org/10.1017/CBO9780511543388

Received 10.06.16