MODIFIED METHOD OF CONSTRUCTING A MULTIVARIATE LINEAR REGRESSION GIVEN BY A REDUNDANT DESCRIPTION

Authors

DOI:

https://doi.org/10.20998/2079-0023.2022.02.01

Keywords:

multivariate linear regression, least squares method, redundant description, cluster analysis, active experiment, linguistic variable

Abstract

A number of scientific works of Prof. O. A. Pavlov and his disciples is devoted to the development of an original method of efficient estimation of coefficients at nonlinear terms of multivariate polynomial regression given by a redundant description under the conditions of an active experiment. The solution of the formulated problem is reduced to the sequential construction of univariate polynomial regressions (finding efficient estimates for the coefficients at nonlinear terms) and solving the corresponding systems of linear nondegenerate equations, the variables of which are the estimates for coefficients at nonlinear terms of the multivariate polynomial regression given by the redundant description. Thus, the problem was reduced to the estimation of the coefficients at linear terms of a multivariate linear regression given by a redundant description in the conditions of an active experiment. We have proposed an original method of its solution that uses a cluster analysis algorithm. The algorithm’s implementation significantly reduces the enumeration of partial descriptions of multivariate linear regression followed by the finding of the residual sum of squares for each of them. This allows using the chi-squared criterion to build a linguistic variable which value gives a qualitative assessment (high reliability, acceptable reliability, low reliability, unreliability) to the obtained result. The analysis of the computational experiments made it possible to modify the proposed method, which significantly increased its efficiency, first of all, of finding a reliable structure of the sought multivariate linear regression given by the redundant description. The method modification, in particular, has reduced the enumeration of partial descriptions and has led to a more efficient use of the general procedure of the least squares method.

Author Biographies

Alexander Pavlov, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”

Doctor of Technical Sciences, Full Professor of Informatics and Software Engineering Department of the National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”; Kyiv, Ukraine

Maxim Holovchenko, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”

Senior Lecturer of Informatics and Software Engineering Department of the National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”; Kyiv, Ukraine

References

Yu L. Using negative binomial regression analysis to predict software faults: a study of Apache Ant. International Journal of Information Technology and Computer Science (IJITCS). 2012, vol. 4, no. 8, pp. 63–70. doi: 10.5815/ijitcs.2012.08.08

Shahrel M.Z., Mutalib S., Abdul-Rahman S. PriceCop – price monitor and prediction using linear regression and LSVM-ABC methods for e-commerce platform. International Journal of Information Engineering and Electronic Business (IJIEEB). 2021, vol. 13, no. 1, pp. 1–14. doi: 10.5815/ijieeb.2021.01.01

Satter A., Ibtehaz N. A regression based sensor data prediction technique to analyze data trustworthiness in cyber-physical system. International Journal of Information Engineering and Electronic Business (IJIEEB). 2018, vol. 10, no. 3, pp. 15–22. doi: 10.5815/ ijieeb.2018.03.03

Isabona J., Ojuh D. O. Machine learning based on kernel function controlled gaussian process regression method for in-depth extrapolative analysis of Covid-19 daily cases drift rates. International Journal of Mathematical Sciences and Computing (IJMSC). 2021, vol. 7, No. 2, pp. 14–23. doi: 10.5815/ ijmsc.2021.02.02

Sinha P. Multivariate polynomial regression in data mining: methodology, problems and solutions. International Journal of Scientific & Engineering Research. 2013, vol. 4, iss. 12, pp. 962–965

Kalivas J. H. Interrelationships of multivariate regression methods using eigenvector basis sets. Journal of Chemometrics. 1999, vol. 13 (2), pp. 111–132. doi: 10.1002/(SICI)1099-128X(199903/ 04)13:2<111::AID-CEM532>3.0.CO;2-N

Ortiz-Herrero L., Maguregui M. I., Bartolomé L. Multivariate (O)PLS regression methods in forensic dating. TrAC Trends in Analytical Chemistry. 2021, vol. 141, 116278. doi: 10.1016/ j.trac.2021.116278

Guo G., Niu G., Shi Q. et al. Multi-element quantitative analysis of soils by laser induced breakdown spectroscopy (LIBS) coupled with univariate and multivariate regression methods. Analytical Methods. 2019, vol. 11, iss. 23, pp. 3006–3013, doi: 10.1039/C9AY00890J.

Babatunde G., Emmanuel A. A., Oluwaseun O. R., Bunmi O. B., Precious A. E. Impact of climatic change on agricultural product yield using k-means and multiple linear regressions. International Journal of Education and Management Engineering (IJEME). 2019, vol. 9, no. 3, pp. 16–26. doi: 10.5815/ijeme.2019.03.02

Pavlov A. A. Holovchenko M. N., Drozd V. V. Construction of a multivariate polynomial given by a redundant description in stochastic and deterministic formulations using an active experiment. Visnyk Nats. tekhn. un-tu "KhPI": zb. nauk. pr. Temat. vyp.: Systemnyy analiz, upravlinnya ta informatsiyni tekhnologiyi [Bulletin of the National Technical University "KhPI": a collection of scientific papers. Thematic issue: System analysis, management and information technology]. Kharkov, NTU "KhPI" Publ., 2022, no. 1 (7), pp. 3–8. doi: 10.20998/2079-0023.2022.01.01

Pavlov A., Holovchenko M., Mukha I., Lishchuk K. Mathematics and software for building nonlinear polynomial regressions using estimates for univariate polynomial regressions coefficients with a given (small) variance. Lecture Notes on Data Engineering and Communications Technologies. 2022, vol. 134, pp. 288–303. doi: 10.1007/978-3-031-04812-8_25

Pavlov O. A., Holovchenko M. M., Revych M. M. Metod otsinky koefitsiyentiv pry liniynykh chlenakh bahatovymirnoyi polinomial'noyi rehresiyi, zadanoyi nadlyshkovym opysom. [Method for estimating coefficients for linear terms of multidimensional polynomial regression given by redundant description] Adaptyvni systemy avtomatychnoho upravlinnya: mizhvidomchyy nauk.-tekhn. zbirnyk [Adaptive systems of automatic control: interdepartmental scientific and technical. collection]. Kyiv, NTUU "KPI" Publ., 2022, vol. 1, no. 40, pp. 110–117. doi: 10.20535/1560- 8956.40.2022.261665

Downloads

Published

2023-01-13

How to Cite

Pavlov, A., & Holovchenko, M. (2023). MODIFIED METHOD OF CONSTRUCTING A MULTIVARIATE LINEAR REGRESSION GIVEN BY A REDUNDANT DESCRIPTION. Bulletin of National Technical University "KhPI". Series: System Analysis, Control and Information Technologies, (2 (8), 3–8. https://doi.org/10.20998/2079-0023.2022.02.01

Issue

Section

SYSTEM ANALYSIS AND DECISION-MAKING THEORY