Systematic Literature Review on Multivariate Analysis: Research Trends, Methods and Frameworks
Systematic Literature Review on Multivariate Analysis: Research Trends, Methods and Frameworks
Abstract
The focus of this research is to look at the development of analytical multivariate statistical research from 2000-2025. This study tries to identify fundamentally and thoroughly which journal-related multivariate analysis developments are the most significant, the most influential researchers, what research topics are developing, the types of datasets and methods used in multivariate analysis. Bibliometric analysis is used to look systematically based on relevant information from scientific publications, multivariate analysis articles accessed through IEEE Explore and Scopus. In the bibliometric analysis stage using Vosviewer, as many as 483 journals were analyzed for the number of citations, analysis of interconnected keywords and others. Therefore, it was found that the most significant journals were IEEE Transactions on Biomedical Engineering, IEEE Transactions on Geoscience and Remote Sensing. The most influential authors are B. Aiazzi; S. Baronti; M. Selva; with a total of 643 citations writing about the regression multivariate adopted to improve spectral quality. Emerging Research Topics Multivariate Time Series Forecasting. Methods that often appear are Regression, Correlations, Clustering, Principle Component Analysis.
References
Ahmad, A., & Brown, G. (2014). Random Projection Random Discretization Ensembles—Sets of Linear Multivariate Decision Trees. IEEE Transactions on Knowledge and Data Engineering, 26(5), 1225–1239. https://doi.org/10.1109/TKDE.2013.134
Ahmed, M. U., & Mandic, D. P. (2012). Multivariate Multiscale Entropy Analysis. IEEE Signal Processing Letters, 19(2), 91–94. https://doi.org/10.1109/LSP.2011.2180713
Aiazzi, B., Baronti, S., & Selva, M. (2007). Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data. IEEE Transactions on Geoscience and Remote Sensing, 45(10), 3230–3239. https://doi.org/10.1109/TGRS.2007.901007
Alduais, N. A. M., Abdullah, J., Jamil, A., & Heidari, H. (2017). Performance Evaluation of Real-Time Multivariate Data Reduction Models for Adaptive-Threshold in Wireless Sensor Networks. IEEE Sensors Letters, 1(6), 1–4. https://doi.org/10.1109/LSENS.2017.2768218
An, Y., & Liu, D. (2019). Multivariate Gaussian-Based False Data Detection Against Cyber-Attacks. IEEE Access, 7, 119804–119812. https://doi.org/10.1109/ACCESS.2019.2936816
Anderson, M., Adali, T., & Li, X.-L. (2012). Joint Blind Source Separation With Multivariate Gaussian Model: Algorithms and Performance Analysis. IEEE Transactions on Signal Processing, 60(4), 1672–1683. https://doi.org/10.1109/TSP.2011.2181836
Arenas-Garcia, J., Petersen, K. B., Camps-Valls, G., & Hansen, L. K. (2013). Kernel Multivariate Analysis Framework for Supervised Subspace Learning: A Tutorial on Linear and Kernel Multivariate Methods. IEEE Signal Processing Magazine, 30(4), 16–29. https://doi.org/10.1109/MSP.2013.2250591
A-review-of-multivariate-analysis-2u9l6a05k2. (n.d.).
Arksey, H., & O'Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Cappers, B. C. M., & Van Wijk, J. J. (2018). Exploring Multivariate Event Sequences Using Rules, Aggregations, and Selections. IEEE Transactions on Visualization and Computer Graphics, 24(1), 532–541. https://doi.org/10.1109/TVCG.2017.2745278
Chen, Z., & Wang, H. (2022). Research on Audit Simulation of Accounting Computerization Based on Internet Complex Discrete Dynamic Modeling Technology. Mathematical Problems in Engineering, 2022, 1–9. https://doi.org/10.1155/2022/5854105
Crino, S., & Brown, D. E. (2007). Global Optimization With Multivariate Adaptive Regression Splines. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), 37(2), 333–340. https://doi.org/10.1109/TSMCB.2006.883430
Deepa, N., Khan, M. Z., Prabadevi, B., Vincent P. M., D. R., Maddikunta, P. K. R., & Gadekallu, T. R. (2020). Multiclass Model for Agriculture Development Using Multivariate Statistical Method. IEEE Access, 8, 183749–183758. https://doi.org/10.1109/ACCESS.2020.3028595
Dell'Acqua, P., Bellotti, F., Berta, R., & De Gloria, A. (2015). Time-Aware Multivariate Nearest Neighbor Regression Methods for Traffic Flow Prediction. IEEE Transactions on Intelligent Transportation Systems, 16(6), 3393–3402. https://doi.org/10.1109/TITS.2015.2453116
Diansheng Guo. (2009). Flow Mapping and Multivariate Visualization of Large Spatial Interaction Data. IEEE Transactions on Visualization and Computer Graphics, 15(6), 1041–1048. https://doi.org/10.1109/TVCG.2009.143
Ding, J., Liu, H., Yang, L. T., Yao, T., & Zuo, W. (2020). Multiuser Multivariate Multiorder Markov-Based Multimodal User Mobility Pattern Prediction. IEEE Internet of Things Journal, 7(5), 4519–4531. https://doi.org/10.1109/JIOT.2019.2951134
Durichen, R., Pimentel, M. A. F., Clifton, L., Schweikard, A., & Clifton, D. A. (2015). Multitask Gaussian Processes for Multivariate Physiological Time-Series Analysis. IEEE Transactions on Biomedical Engineering, 62(1), 314–322. https://doi.org/10.1109/TBME.2014.2351376
Ermolova, N. Y., & Tirkkonen, O. (2012). Multivariate η-μ Fading Distribution with Constant Correlation Model. IEEE Communications Letters, 16(4), 454–457. https://doi.org/10.1109/LCOMM.2012.020712.112160
Fujiwara, T., Shilpika, Sakamoto, N., Nonaka, J., Yamamoto, K., & Ma, K.-L. (2021). A Visual Analytics Framework for Reviewing Multivariate Time-Series Data with Dimensionality Reduction. IEEE Transactions on Visualization and Computer Graphics, 27(2), 1601–1611. https://doi.org/10.1109/TVCG.2020.3028889
Georga, E. I., Protopappas, V. C., Ardigo, D., Marina, M., Zavaroni, I., Polyzos, D., & Fotiadis, D. I. (2013). Multivariate Prediction of Subcutaneous Glucose Concentration in Type 1 Diabetes Patients Based on Support Vector Regression. IEEE Journal of Biomedical and Health Informatics, 17(1), 71–81. https://doi.org/10.1109/TITB.2012.2219876
He, H., & Tan, Y. (2020). Unsupervised Classification of Multivariate Time Series Using VPCA and Fuzzy Clustering With Spatial Weighted Matrix Distance. IEEE Transactions on Cybernetics, 50(3), 1096–1105. https://doi.org/10.1109/TCYB.2018.2883388
James, F. C., & McCulloch, C. E. (1990). Multivariate Analysis in Ecology and Systematics: Panacea or Pandora's Box? Annual Review of Ecology and Systematics, 21(1), 129–166. https://doi.org/10.1146/annurev.es.21.110190.001021
Javed, K., Gouriveau, R., & Zerhouni, N. (2015). A New Multivariate Approach for Prognostics Based on Extreme Learning Machine and Fuzzy Clustering. IEEE Transactions on Cybernetics, 45(12), 2626–2639. https://doi.org/10.1109/TCYB.2014.2378056
Karadayi, Y., Aydin, M. N., & Ogrenci, A. S. (2020). Unsupervised Anomaly Detection in Multivariate Spatio-Temporal Data Using Deep Learning: Early Detection of COVID-19 Outbreak in Italy. IEEE Access, 8, 164155–164177. https://doi.org/10.1109/ACCESS.2020.3022366
Karami, J., Alimohammadi, A., & Modabberi, S. (2012a). Analysis of the Spatio-Temporal Patterns of Water Pollution and Source Contribution Using the MODIS Sensor Products and Multivariate Statistical Techniques. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 5(4), 1243–1255. https://doi.org/10.1109/JSTARS.2012.2187273
Karami, J., Alimohammadi, A., & Modabberi, S. (2012b). Analysis of the Spatio-Temporal Patterns of Water Pollution and Source Contribution Using the MODIS Sensor Products and Multivariate Statistical Techniques. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 5(4), 1243–1255. https://doi.org/10.1109/JSTARS.2012.2187273
Karatuğ, Ç., Arslanoğlu, Y., & Soares, C. G. (2023). Review of maintenance strategies for ship machinery systems. Journal of Marine Engineering & Technology, 22(5), 233–247. https://doi.org/10.1080/20464177.2023.2180831
Khan, N., Aslam, M., Aldosari, M. S., & Jun, C.-H. (2018). A Multivariate Control Chart for Monitoring Several Exponential Quality Characteristics Using EWMA. IEEE Access, 6, 70349–70358. https://doi.org/10.1109/ACCESS.2018.2881054
Krzanowski, W. J. (2014). Multivariate Analysis: Overview. In R. S. Kenett, N. T. Longford, W. W. Piegorsch, & F. Ruggeri (Eds.), Wiley StatsRef: Statistics Reference Online (1st ed.). Wiley. https://doi.org/10.1002/9781118445112.stat06467
Li, C., Zheng, J., Pan, H., Tong, J., & Zhang, Y. (2019). Refined Composite Multivariate Multiscale Dispersion Entropy and Its Application to Fault Diagnosis of Rolling Bearing. IEEE Access, 7, 47663–47673. https://doi.org/10.1109/ACCESS.2019.2907997
Lim, Yong B., Kim, Sang Ik, Ree, Sang Bok, & Jang, Dae-Heung. (2016). Literature Review on the Statistical Methods in KSQM for 50 Years. Journal of Korean Society for Quality Management, 44(2), 221–244. https://doi.org/10.7469/JKSQM.2016.44.2.221
Lu, S., & Huang, S. (2020). Segmentation of Multivariate Industrial Time Series Data Based on Dynamic Latent Variable Predictability. IEEE Access, 8, 112092–112103. https://doi.org/10.1109/ACCESS.2020.3002257
Lv, F., He, W., & Zhao, L. (2020). A Multivariate Optimal Control Strategy for the Attitude Tracking of a Parafoil-UAV System. IEEE Access, 8, 43736–43751. https://doi.org/10.1109/ACCESS.2020.2977535
Madjido, M. (2021). Mapping the topic of health information system (sik) publications in Indonesia: Bibliometric analysis. Journal of Information Systems for Public Health, 6(1), 29. https://doi.org/10.22146/jisph.44122
Marchant, C., Leiva, V., & Cysneiros, F. J. A. (2016). A Multivariate Log-Linear Model for Birnbaum-Saunders Distributions. IEEE Transactions on Reliability, 65(2), 816–827. https://doi.org/10.1109/TR.2015.2499964
Marchy, F., & Juandi, D. (2023). Student's Statistical Literacy Skills (1980-2023): A Systematic Literature Review with Bibliometric Analysis. Journal of Education and Learning Mathematics Research (JELMaR), 4(1), 31–45. https://doi.org/10.37303/jelmar.v4i1.105
Markley, S. C., & Miller, D. J. (2010). Joint Parsimonious Modeling and Model Order Selection for Multivariate Gaussian Mixtures. IEEE Journal of Selected Topics in Signal Processing, 4(3), 548–559. https://doi.org/10.1109/JSTSP.2009.2038312
Miao, Z., Shi, W., Zhang, H., & Wang, X. (2013). Road Centerline Extraction From High-Resolution Imagery Based on Shape Features and Multivariate Adaptive Regression Splines. IEEE Geoscience and Remote Sensing Letters, 10(3), 583–587. https://doi.org/10.1109/LGRS.2012.2214761
Ming-Da Ma, Wong, D. S.-H., Shi-Shang Jang, & Sheng-tsaing Tseng. (2010). Fault Detection Based on Statistical Multivariate Analysis and Microarray Visualization. IEEE Transactions on Industrial Informatics, 6(1), 18–24. https://doi.org/10.1109/TII.2009.2030793
Mohammed V University in Rabat, EMI-SIWEB Team, Rabat, Morocco, Tikito, I., & Souissi, N. (2019). Meta-analysis of Systematic Literature Review Methods. International Journal of Modern Education and Computer Science, 11(2), 17–25. https://doi.org/10.5815/ijmecs.2019.02.03
Mujahid, T., Rahman, A. U., & Khan, M. M. (2017). GPU-Accelerated Multivariate Empirical Mode Decomposition for Massive Neural Data Processing. IEEE Access, 5, 8691–8701. https://doi.org/10.1109/ACCESS.2017.2705136
Naveed, K., & Rehman, N. U. (2020). Wavelet Based Multivariate Signal Denoising Using Mahalanobis Distance and EDF Statistics. IEEE Transactions on Signal Processing, 68, 5997–6010. https://doi.org/10.1109/TSP.2020.3029659
Park, S.-H., Simeone, O., Sahin, O., & Shamai, S. (2013). Joint Precoding and Multivariate Backhaul Compression for the Downlink of Cloud Radio Access Networks. IEEE Transactions on Signal Processing, 61(22), 5646–5658. https://doi.org/10.1109/TSP.2013.2280111
Peruchi, R. S., Rotela Junior, P., Brito, T. G., Paiva, A. P., Balestrassi, P. P., & Mendes Araujo, L. M. (2020). Integrating Multivariate Statistical Analysis Into Six Sigma DMAIC Projects: A Case Study on AISI 52100 Hardened Steel Turning. IEEE Access, 8, 34246–34255. https://doi.org/10.1109/ACCESS.2020.2973172
Petticrew, M., & Roberts, H. (2006). Systematic Reviews in the Social Sciences: A Practical Guide (1st ed.). Wiley. https://doi.org/10.1002/9780470754887
Raj, A., Shah, N. A., Tiwari, A. K., & Martini, M. G. (2020). Multivariate Regression-Based Convolutional Neural Network Model for Fundus Image Quality Assessment. IEEE Access, 8, 57810–57821. https://doi.org/10.1109/ACCESS.2020.2982588
Ren, P., Bosch Bayard, J. F., Dong, L., Chen, J., Mao, L., Ma, D., Sanchez, M. A., Morejon, D. M., Bringas, M. L., Yao, D., Jahanshahi, M., & Valdes-Sosa, P. A. (2020). Multivariate Analysis of Joint Motion Data by Kinect: Application to Parkinson's Disease. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 28(1), 181–190. https://doi.org/10.1109/TNSRE.2019.2953707
Rezaeieh, S. A., Brankovic, A., Janani, A. S., Mohammed, B., Darvazehban, A., Zamani, A., Macdonald, G. A., & Abbosh, A. M. (2020). Wearable Electromagnetic Belt for Steatotic Liver Detection Using Multivariate Energy Statistics. IEEE Access, 8, 201847–201860. https://doi.org/10.1109/ACCESS.2020.3035657
Riaz, M., Ajadi, J. O., Mahmood, T., & Abbasi, S. A. (2019). Multivariate Mixed EWMA-CUSUM Control Chart for Monitoring the Process Variance-Covariance Matrix. IEEE Access, 7, 100174–100186. https://doi.org/10.1109/ACCESS.2019.2928637
Sahu, T. P., Nagwani, N. K., & Verma, S. (2016). Multivariate Beta Mixture Model for Automatic Identification of Topical Authoritative Users in Community Question Answering Sites. IEEE Access, 4, 5343–5355. https://doi.org/10.1109/ACCESS.2016.2609279
Shanableh, T. (2012). Data Hiding in MPEG Video Files Using Multivariate Regression and Flexible Macroblock Ordering. IEEE Transactions on Information Forensics and Security, 7(2), 455–464. https://doi.org/10.1109/TIFS.2011.2177087
Shen, F., Zheng, J., Ye, L., & Ma, X. (2020). LSTM Soft Sensor Development of Batch Processes With Multivariate Trajectory-Based Ensemble Just-in-Time Learning. IEEE Access, 8, 73855–73864. https://doi.org/10.1109/ACCESS.2020.2988668
Skute, I. (2019). Opening the black box of academic entrepreneurship: A bibliometric analysis. Scientometrics, 120(1), 237–265. https://doi.org/10.1007/s11192-019-03116-w
Succetti, F., Rosato, A., Araneo, R., & Panella, M. (2020). Deep Neural Networks for Multivariate Prediction of Photovoltaic Power Time Series. IEEE Access, 8, 211490–211505. https://doi.org/10.1109/ACCESS.2020.3039733
Sun, X., Wang, X., Cai, D., Li, Z., Gao, Y., & Wang, X. (2020). Multivariate Seawater Quality Prediction Based on PCA-RVM Supported by Edge Computing Towards Smart Ocean. IEEE Access, 8, 54506–54513. https://doi.org/10.1109/ACCESS.2020.2981528
Tandeo, P., Autret, E., Piolle, J. F., Tournadre, J., & Ailliot, P. (2009). A Multivariate Regression Approach to Adjust AATSR Sea Surface Temperature to In Situ Measurements. IEEE Geoscience and Remote Sensing Letters, 6(1), 8–12. https://doi.org/10.1109/LGRS.2008.2006568
Teng-Yok Lee & Han-Wei Shen. (2009). Visualization and exploration of temporal trend relationships in multivariate time-varying data. IEEE Transactions on Visualization and Computer Graphics, 15(6), 1359–1366. https://doi.org/10.1109/TVCG.2009.200
Toubeau, J.-F., Bottieau, J., Vallee, F., & De Greve, Z. (2019). Deep Learning-Based Multivariate Probabilistic Forecasting for Short-Term Scheduling in Power Markets. IEEE Transactions on Power Systems, 34(2), 1203–1215. https://doi.org/10.1109/TPWRS.2018.2870041
Tupan, T., Rahayu, R. N., Rachmawati, R., & Rahayu, E. S. R. (2018). BIBLIOMETRIC ANALYSIS OF RESEARCH DEVELOPMENTS IN THE FIELD OF INSTRUMENTATION SCIENCE. READ: JOURNAL OF DOCUMENTATION AND INFORMATION, 39(2), 135. https://doi.org/10.14203/j.baca.v39i2.413
Ur Rehman, N., & Mandic, D. P. (2011). Filter Bank Property of Multivariate Empirical Mode Decomposition. IEEE Transactions on Signal Processing, 59(5), 2421–2426. https://doi.org/10.1109/TSP.2011.2106779
Vallet, P., Loubaton, P., & Mestre, X. (2012). Improved Subspace Estimation for Multivariate Observations of High Dimension: The Deterministic Signals Case. IEEE Transactions on Information Theory, 58(2), 1043–1068. https://doi.org/10.1109/TIT.2011.2173718
Wahono, R. S. (2015). A Systematic Literature Review of Software Defect Prediction: Research Trends, Datasets, Methods and Frameworks. Journal of Software Engineering, 1(1).
Wang, D., Huang, L., & Tang, L. (2018). Dissipativity and Synchronization of Generalized BAM Neural Networks With Multivariate Discontinuous Activations. IEEE Transactions on Neural Networks and Learning Systems, 29(8), 3815–3827. https://doi.org/10.1109/TNNLS.2017.2741349
Wang, H., Zhang, Y., Waytowich, N. R., Krusienski, D. J., Zhou, G., Jin, J., Wang, X., & Cichocki, A. (2016). Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 24(5), 532–541. https://doi.org/10.1109/TNSRE.2016.2519350
Ya Su, Xinbo Gao, Xuelong Li, & Dacheng Tao. (2012). Multivariate Multilinear Regression. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(6), 1560–1573. https://doi.org/10.1109/TSMCB.2012.2195171
Ye, Z., Mistry, S., Bouguettaya, A., & Dong, H. (2016). Long-Term QoS-Aware Cloud Service Composition Using Multivariate Time Series Analysis. IEEE Transactions on Services Computing, 9(3), 382–393. https://doi.org/10.1109/TSC.2014.2373366
Yu, Y., Wang, J., & Ouyang, Z. (2020). Designing Dynamic Alarm Limits and Adjusting Manipulated Variables for Multivariate Systems. IEEE Transactions on Industrial Electronics, 67(3), 2314–2325. https://doi.org/10.1109/TIE.2019.2903757
Zeng, K., Chen, D., Ouyang, G., Wang, L., Liu, X., & Li, X. (2016). An EEMD-ICA Approach to Enhancing Artifact Rejection for Noisy Multivariate Neural Data. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 24(6), 630–638. https://doi.org/10.1109/TNSRE.2015.2496334
Zhao, P., Chang, X., & Wang, M. (2021). A Novel Multivariate Time-Series Anomaly Detection Approach Using an Unsupervised Deep Neural Network. IEEE Access, 9, 109025–109041. https://doi.org/10.1109/ACCESS.2021.3101844
Zupic, I., & Čater, T. (2015). Bibliometric Methods in Management and Organization. Organizational Research Methods, 18(3), 429–472. https://doi.org/10.1177/1094428114562629






