DOI:https://doi.org/10.15407/kvt194.04.041

Kibern. vyčisl. teh., 2018, Issue 4 (194), pp.

**V.S. STEPASHKO**, DSc (Engineering), Professor,

Head of Dep. for Information Technologies of Inductive Modeling

e-mail: stepashko@irtc.org.ua

International Research and Training Center for Information Technologies

and Systems of the National Academy of Sciences of Ukraine

and Ministry of Education and Science of Ukraine,

Acad. Glushkov av., 40, Kyiv, 03187, Ukraine

**FORMATION AND DEVELOPMENT OF SELF-ORGANIZING INTELLIGENT TECHNOLOGIES OF INDUCTIVE MODELING**

**Conclusions**. Main prerequisites facilitating the creation of the GMDH by O.H. Ivakhnenko were analysed, basic fundamental, technological and applied achievements of the half-century development of inductive modeling both in Ukraine and abroad were characterized, as well as the most prospective ways of further research were formulated.

** Keywords**:

*mathematical modeling, data-driven approach, model self-organization, GMDH, inductive modelling, noise-immune modelling, information technology, case study.*

**REFERENCES**

- Ivakhnenko A.G., Müller J.-A. Recent Developments of Self-Organizing Modeling in Prediction and Analysis of Stock Market. Microelectronics Reliability. 1997. No. 37,

pp. 1053–1072. - Anastasakis L., Mort N. The Development of Self-Organization Techniques in Modelling: A Review of the Group Method of Data Handling (GMDH). ACSE Research Report 813. The University of Sheffield, 2001. 39 p.
- Snorek M., Kordik P. Inductive Modelling World Wide the State of the Art. Proc. of 2nd Int. Workshop on Inductive Modelling, 19–23 September 2007. Prague: CTU, 2007, pp. 302–304.
- Stepashko V. Developments and Prospects of GMDH-Based Inductive Modeling. In: Advances in Intelligent Systems and Computing II: Selected Papers from the Intern. Conf. on Computer Science and Information Technologies, CSIT 2017, Lviv, Ukraine / N. Shakhovska, V. Stepashko, Editors. AISC book series, Vol. 689. Cham: Springer, 2018, pp. 474–491.
- Ivakhnenko A.G. Electroautomatics. Kiev: Gostekhizdat UkrSSR, 1957. 452 p. (In Russian)
- Ivakhnenko A.G., Petina N.V. Voltage stabilizers with combined control. Kiev: AS UkrSSR publisher, 1958. 247 p. (In Russian)
- Ivakhnenko A.G. Engineering cybernetics. Kiev: Gostekhizdat UkrSSR, 1959. 432 p. (In Russian)
- Ivakhnenko A.G., Lapa V.G. Cybernetic predicting devices. Kiev: Naukova dumka, 1965. 213 p. (In Russian)
- Rosenblatt F. Principles of Neurodynamic: Perceptrons and the Theory of Brain Mechanisms. Washington: Spartan Books, 1962. 616 p.
- Ivakhnenko A.G. Method of Group Using of Arguments as a Rival of Stochastic Approximation Method. Avtomatyka. 1968. № 3. P. 58–72. (In Ukrainian)
- Ivakhnenko A.G. Group Method of Data Handling as a Rival of Stochastic Approximation Method. Soviet Automatic Control. 1968. Nо. 3, pp. 43–55.
- Ivakhnenko A.G. Heuristic Self-Organization in Problems of Automatic Control. Automatica (IFAC). 1970. No. 6, pp. 207–219.
- Ivakhnenko A.G. Polynomial theory of complex systems. IEEE Trans. Sys., Man and Cyb. 1971. 1, No 4, pp. 364–378.
- Ivakhnenko A.G. Heuristic self-organization systems in engineering cybernetics. Kiev: Tekhnika, 1971. 392 p. (In Russian)
- Ivakhnenko A.G. Inductive method of self-organization of complex systems. Kiev: Naukova dumka, 1982. 296 p. (In Russian)
- Madala H.R., Ivakhnenko A.G. Inductive Learning Algorithms for Complex Systems Modeling. London, Tokyo: CRC Press Inc., 1994. 384 p.
- Ivakhnenko A.G., Zaichenko Yu.P., Dimitrov V.D. Decision making based on self-organization. Moscow: Sov. radio, 1976. 280 p. (In Russian)
- Ivakhnenko A.G., Stepashko V.S. Noise-immunity of modeling. Kiev: Naukova dumka, 1985. 216 p. (In Russian)
- Ivakhnenko A.G., Yurachkovskiy Yu.P. Modeling of complex systems from experimental data. — Moscow: Radio i svyaz, 1987. 120 p. (In Russian)
- Stepashko V.S. A Combinatorial Algorithm of the Group Method of Data Handling with Optimal Model Scanning Scheme. Soviet Automatic Control. 1981. 14(3), pp. 24–28.
- Stepashko V.S. A Finite Selection Procedure for Pruning an Exhaustive Search of Models. Soviet Automatic Control. 1983. 16(4), pp. 88–93.
- Shelud’ko O.I. GMDH Algorithm with Orthogonalized Complete Description for Synthesis of Models by the Results of a Planned Experiment. Soviet Automatic Control. 1974. 7(5), pp. 24–33.
- Yurachkovsky Yu.P. Convergence of Multilayer Algorithms of the Group Method of Data Handling, Soviet Automatic Control. 1981. 14(3), pp. 29–34.
- Yurachkovsky Yu.P. Restoration of Polynomial Dependencies Using Self-Organization. Soviet Automatic Control. 1981. 14(4), pp. 17–22.
- Ivakhnenko A.G. Long-term forecasting and control of complex systems. Kiev: Tekhnika, 1975. 311 с. (In Russian)
- Ivakhnenko A.G., Karpinsky A.M. Computer-Aided Self-Organization of Models in Terms of the General Communication Theory (Information Theory). Soviet Automatic Control. 1982. 15(4), pp. 7–15.
- Stepashko V.S. Potential noise stability of modelling using the combinatorial GMDH algorithm without information regarding the noise. Soviet Automatic Control. 16(3), 1983. P. 15–25.
- Stepashko V.S., Kostenko Yu.V. A GMDH Algorithm for Two-level Modeling of Multidimensional Cyclic Processes. Soviet Automatic Control. 1987. 20(4), pp. 49–57.
- Ivakhnenko A.G., Osipenko V.V., Strokova T.I. Prediction of Two-dimensional Physical Fields Using Inverse Transition Matrix Transformation. Soviet Automatic Control. 1983. 16(4), P. 10–15.
- Ivakhnenko A.G. Inductive Sorting Method for the Forecasting of Multidimensional Random Processes and Events with the Help of Analogs Forecast Complexing. Pattern Recogn. and Image Analysis. 1991. 1(1), P. 99–108.
- Ivakhnenko A.G. Kostenko Yu.V. System Analysis and Long-Term Prediction on the Basis of Model Self-organisation (OSA algorithm). Soviet Automatic Control. 1982. 15(3), pp. 11–17.
- Ivakhnenko A.G. Objective Computer Clasterization Based on Self-Organisation Theory. Soviet Automatic Control. 1987. 20(6), pp. 1–7.
- Vysotskiy V.N., Ivakhnenko A.G., Cheberkus V.I. Long Term Prediction of Oscillatory Processes by Finding a Harmonic Trend of Optimum Complexity by the Balance-of-Variables Criterion. Soviet Automatic Control. 1975. 8(1), pp. 18–24.
- Ivakhnenko A.G., Krotov G.I. A Multiplicative-Additive Nonlinear GMDH Algorithm with Optimization of the Power of Factors. Soviet Automatic Control. 1984. 17(3), pp. 10–15.
- Kocherga Yu.L. J-optimal Reduction of Model Structure in the Gauss-Markov Scheme. Soviet J. of Automation and Information Sciences. 1988. 21(4), pp. 34–36.
- Aksenova T.I., YurachkovskyYu.P. A Characterization at Unbiased Structure and Conditions of Their J-Optimality. Sov. J. of Automation and Information Sciences. 1988. 21(4), pp.36–42.
- Ivakhnenko A.G., Kovalchuk P.I., Todua M.M., Shelud’ko O.I., Dubrovin O.F. Unique Construction of Regression Curve Using a Small Number of Points — Part 2. Soviet Automatic Control. 1973. 6(5), pp. 29–41.
- Stepashko V.S. Asymptotic Properties of External Criteria for Model Selection, Soviet Journal of Automation and Information Sciences, 21, Nо. 6, (1988), 84–92.
- Aksenova T.I. Sufficient conditions and convergence rate using different criteria for model selection, Systems Analysis Modelling Simulation, vol. 20, no. 1-2, pp.69–78, 1995.
- Ivakhnenko A.G., Ivakhnenko G.A., Mueller J.A. Self-Organization of Neuronets with Active Neurons. Pattern Recognition and Image Analysis. 1994. 4(4). Р. 177–188.
- Muller J.-A., Lemke F. Self-organizing data mining. An intelligent approach to extract knowledge from data. Berlin, Dresden: Libri BoD, 1999. 225 p.
- Self-organizing methods in modeling: GMDH type algorithms / Ed. S.J. Farlow. New York, Basel: Marcel Decker Inc., 1984. 350 p.
- Voss M.S., Xin Feng. A new methodology for emergent system identification using particle swarm optimization (PSO) and the group method of data handling (GMDH). Proc. of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann Publishers, 2002, pp. 1227–1232.
- Kondo T., Ueno J. Feedback GMDH-Type Neural Network Self-Selecting Optimum Neural Network Architecture and Its Application to 3-Dimensional Medical Image Recognition of the Lungs. Proc. of the II Intern. Workshop on Inductive Modelling IWIM-2007, 19–23 September 2007. Prague: Czech Technical University, 2007. P. 63–70.
- Jirina M., Jirina M. jr. Genetic Selection and Cloning in GMDH MIA Method. Proceedings of the II International Workshop on Inductive Modelling IWIM 2007, Prague, September 23–26, 2007. Prague: CTU, 2007. P. 165–171.
- Lytvynenko V., Bidyuk P., Myrgorod V. Application of the Method and Combined Algorithm on the Basis of Immune Network and Negative Selection for Identification of Turbine Engine Surging. Proceedings of the II International Conference on Inductive Modelling ICIM-2008, 15–19 September 2008, Kyiv, Ukraine. Kyiv: IRTC ITS NASU, 2008. P. 116–123.
- Kordik P. Fully automated knowledge extraction using group of adaptive model evolution: PhD thesis. Prague: Czech Technical University, 2006. 150 р.
- Oh S.K., Pedrycz W., Park H.S. Multi-layer hybrid fuzzy polynomial neural networks: a design in the framework of computational intelligence. Neurocomputing, 2005. 64. P. 397–431.
- Zaychenko Yu. The Investigations of Fuzzy Group Method of Data Handling with Fuzzy Inputs in the Problem of Forecasting in Financial Sphere. Proc. of the II Intern. Conf. on Inductive Modelling ICIM-2008, 15–19 Sept. 2008. Kyiv: IRTC ITS NASU, 2008. P. 129–133.
- Bodyanskiy Ye., Vynokurova O., Teslenko N. Cascade GMDH-Wavelet-Neuro-Fuzzy Network. Proceedings of the IV International Workshop on Inductive Modelling IWIM-2011, Yuly 4–11, 2011, Kyiv-Zhukyn, Ukraine. Kyiv: IRTC ITS NASU, 2011. P. 16–21.
- Voytyuk I., Dyvak M., Spilchuk V. The Method of Structure Identification of Macromodels as Difference Operators Based on the Analysis of Interval Data and Genetic Algorithm. Proceedings of the IV International Workshop on Inductive Modelling IWIM-2011, Yuly 4–11, 2011, Kyiv-Zhukyn, Ukraine. Kyiv: IRTC ITS NASU, 2011. P. 114–118.
- Lemke F. Parallel Self-Organizing Modeling. Proc. of the II Int. Conf. on Inductive Modelling ICIM-2008, 15–19 September 2008, Kyiv, Ukraine. Kyiv: IRTC ITS NASU, 2008. P. 176–183.
- Koshulko O.A., Koshulko A.I. Multistage combinatorial GMDH algorithm for parallel processing of high-dimensional data. Proc. of III Int. Workshop on Inductive Modelling IWIM-2009, Krynica, Poland. Prague: CTU, 2009. P. 114–116.
- Kordík P., Černý J. Advanced Ensemble Strategies for Polynomial Models. Proceedings of the III International Conference on Inductive Modelling ICIM-2010, May 16–22, 2010, Yevpatoria, Crimea, Ukraine. Kherson: KNTU, 2010. P. 77–82.
- Čepek M., Kordík P., Šnorek M. The Effect of Modelling Method to the Inductive Preprocessing Algorithm. Proceedings of the III International Conference on Inductive Modelling ICIM-2010, May 16–22, 2010, Yevpatoria, Crimea, Ukraine. Kherson: KNTU, 2010. P. 131–138.
- Sarychev A.P. System Regularity Criterion of Group Method of Data Handling. Journal of Automation and Information Sciences. 2006. 38(11), pp. 25–37.
- Sarycheva L. Quality Criteria for GMDH-based Clustering. Proceedings of the II International Conference on Inductive Modelling ICIM-2008, 15–19 September 2008, Kyiv, Ukraine. Kyiv: IRTC ITS NASU, 2008. P. 84–90.
- Lemke, F. Insights v.2.0, Self-organizing knowledge mining and forecasting tool, 2013, http://www.knowledgeminer.eu.
- https://www.gmdhshell.com.
- www.mgua.irtc.org.ua
- Stepashko V.S. Method of Critical Variances as Analytical Tool of Theory of Inductive Modeling. Journal of Automation and Information Sciences. 2008. 40(2), pp. 4–22.
- Ivakhnenko A.G., Savchenko E.A. Investigation of Efficiency of Additional Determination Method of the Model Selection in the Modeling Problems by Application of the GMDH Algorithm. Journal of Automation and Information sciences. 2008. 40(3). P. 47–58.
- Stepashko V.S., Efimenko S.M. Sequential Estimation of the Parameters of Regression Models. Cybernetics and Systems Analysis. 2005. 41(4). P.631–634.
- Stepashko V., Yefimenko S. Parallel algorithms for solving combinatorial macromodelling problems. Przegląd Elektrotechniczny (Electrical Review). 2009. 85(4). P 98–99.
- Samoilenko O., Stepashko V. Method of Successive Elimination of Spurious Arguments for Effective Solution the Search-Based Modelling Tasks. Proceedings of the II International Conference on Inductive Modelling ICIM-2008, 15-19 September 2008, Kyiv, Ukraine. Kyiv: IRTC ITS NASU, 2008. P. 36–39.
- Moroz O., Stepashko V. Hybrid sorting-out algorithm COMBI-GA with evolutionary growth of model complexity. In: Advances in Intelligent Systems and Computing II:

Selected Papers from the International Conference on Computer Science and Information Technologies, CSIT 2017, Lviv, Ukraine / N. Shakhovska, V. Stepashko, Ed. AISC, Vol. 689. Cham: Springer, 2018. P. 346–360. - Stepashko V., Bulgakova O., Zosimov V. Construction and Research of the Generalized Iterative GMDH Algorithm with Active Neurons. In: Advances in Intelligent Systems and Computing II: Selected Papers from the International Conference on Computer

Science and Information Technologies, CSIT 2017, Lviv, Ukraine / N. Shakhovska,

V. Stepashko, Editors. AISC book series, Vol. 689. Cham: Springer, 2018. P. 492–510. - Pavlov A.V. Generalized relaxational iterative algorithm of GMDH. Inductive Modeling of Complex Systems. Collected papers. Issue 3. Kyiv: IRTC ITS NASU, 2011.

P. 121–134. (In Ukrainian) - Stepashko, V.S.: Conceptual fundamentals of intelligent modeling. Control Systems and Machines (USiM). 2016. 4, pp. 3–15. (In Russian)
- Yefimenko S.N., Stepashko V.S. Fundamentals of recurrent-and-parallel computing in the combinatorial algorithm COMBI GMDH. USiM. 2014. 6. P. 27–33. (In Russian)
- Yefimenko S.N., Stepashko V.S. Simulation experiment as a means of effectiveness research of modeling methods from observation data. USiM. 2009. 1. P. 69–78. (In Russian)
- Bulgakova O., Zosimov V., Stepashko V. Software package for modeling of complex systems based on iterative GMDH algorithms with the network access capability. System Research and Information Technologies. 1. 2014. P. 43–55. (In Ukrainian)
- Pavlov A. Designing an automated structural-parametric identification system. Inductive Modeling of Complex Systems. Collected papers. Issue 7. Kyiv: IRTC ITS NASU, 2015. P. 202–219. (In Ukrainian)
- Yefimenko S. Building Vector Autoregressive Models Using COMBI GMDH with Recurrent-and-Parallel Computations. In: Advances in Intelligent Systems and Computing II: Selected Papers from the International Conference on Computer Science and

Information Technologies, CSIT 2017, Lviv, Ukraine / N. Shakhovska, V. Stepashko, Editors. AISC book series, Vol. 689. Cham: Springer, 2018. P. 601–613. - Stepashko V., Samoilenko O., Voloschuk R. Informational Support of Managerial Decisions as a New Kind of Business Intelligence Systems. In: Computational Models for Business and Engineering Domains. G. Setlak, K. Markov (Eds.). Rzeszow, Poland; Sofia, Bulgaria: ITHEA, 2014, pp. 269–279.
- Moroz O., Stepashko V. Data reconstruction of seasonal changes of amylolytic microorganisms amount in copper polluted soils. Proceedings of the 13th IEEE International Conference CSIT-2018 & International Workshop on Inductive Modeling, September 11–14, 2018, Lviv, Ukraine. Lviv: Publisher “Vezha&Co”, 2018. P. 479–482.
- Stepashko V.S., Yefimenko S.M., Savchenko Ye.A. Computerized experiment in inductive modeling. Kyiv: Naukova Dumka, 2014. 222 p. (In Ukrainian)
- Pavlov A.V., Stepashko V.S., Kondrashova N.V. Effective methods of models self-organization. Kyiv: Akademperiodika, 2014. 200 p. (In Russian)
- Stepashko V., Bulgakova O., Zosimov V. Iterational algorithms of inductive modeling. Kyiv: Naukova Dumka, 2014. 190 p. (In Ukrainian)
- Schmidhuber J. Deep learning in neural networks: An overview. Neural Networks. 2015. 61, pp. 85–117.

Received 20.09.2018