Registration Number
0223U001898,
0118U001112
, R & D reports
Title
To develop mathematical models and methods of analysis and synthesis of information processes for creation of intellectual interface and alternative communication.
popup.stage_title
Head
Krak Yuriy V, Доктор фізико-математичних наук
Registration Date
05-02-2023
Organization
V.M. Glushkov Institute of Cybernetics of the National Academy of Sciences of Ukraine
popup.description2
The purpose of this work is the development of mathematical models and methods of analysis and synthesis of information processes for the tasks of building intelligent interface systems and alternative communication. Of greatest interest for this study are: formalization of a limited set elements using information models, selection of alternative information and its reproduction on modern computers.
The following tasks were performed: the changes of characteristic features in the video stream using alternative input of information were determined, algorithms for the classification of facial expressions and creating a spatial model of the human head were developed, and methods of analysis of dynamically changing and hidden features in communication were created.
Methods of hyperplane classification, pseudo-inversion, model ensembles, methods of visual analytics and decision-making were widely applied. Environments for C#, Python, and Scala were used for experimental implementation.
The technology for recognizing sign language with the involvement of 3D convolutional neural networks has been developed. The technology of cascade processing of heterogeneous information has been developed, using methods of hyperplane classification, feature grouping and deep learning all in-one.
The practical significance of the obtained results lies in the development of mathematical models, methods of analysis and synthesis. In particular, infological, parametric, mathematical models and methods for modeling and recognizing gestures, text and non-verbal information have been developed.
Based on the results, 87 works were published, including: 3 monographs published abroad, 7 chapters in monographs published abroad, 25 articles (16 of them in Scopus), 52 reports (52 of them in Scopus).
The report consists of an introduction, four chapters, conclusions, a list of used sources and appendices. The total volume of report is 220 p; 77 figures, 4 tables; a list of sources with 382 entries.
Product Description
popup.authors
Kondratiuk Serhii S.
Kudin Hryhoriy І.
Kuznyetsov Vladyslav Oleksandrovych
Kulyas Anatolii Ivanovych
Petrovych Valentyna Mykolayivna
Selesov Ihor T.
Horozov Oleh A.
popup.nrat_date
2023-02-05
