The problem of constructing gesture commands for controlling a small unmanned aerial vehicle, such as a quadcopter, is considered. Commands coming from a video camera are identified by a classifier based on a convolutional neural network, and the multimodal control interface equipped with an intelligent solver converts them into control commands for the quadcopter. Neural networks from the Ultralytics neural network library allow selecting targets in a frame in real-time. The commands are sent to a specialized program on a smartphone, developed on the basis of DJI SDK flight simulators, which then sends commands via the remote control channel. The quality of recognition of developed gesture commands for DJI Phantom 3 standard edition quadcopters is investigated, and a brief guide in the form of operator work scenarios with unmanned vehicles is provided. The prospects of gesture control of several vehicles in extreme conditions have been revealed, considering the complex safety challenges of joint flight and interaction of aircraft in confined space.
DOI: 10.25209/2079-3316-2024-15-2-21-36
Download the article (PDF) at the Program Systems: Theory and Applications journal website (in Russian): https://psta.psiras.ru/ru/2024/2_21-36.html
Download the article (PDF) at the Intelligent Control Laboratory of the Program Systems Institute of the RAS website: (in Russian): https://icontrol.psiras.ru/publications/
Download the article (PDF) from eLibrary (in Russian, registration required): https://www.elibrary.ru/item.asp?id=68521168
Download the article (PDF) at Math-Net.Ru (in Russian): https://www.mathnet.ru/eng/ps441
Nikolai S. Abramov, Vita V. Sattarova, Vitaly P. Fralenko, Mikhail V. Khachumov. Gesture control of small unmanned aerial vehicle flight // Program Systems: Theory and Applications, 2024, 15:2, pp. 21–36. (In Russ.).