Visualization of Correlation Tables by Positive/Negative Threshold for Coefficients Significance

Mullat, Joseph (2025): Visualization of Correlation Tables by Positive/Negative Threshold for Coefficients Significance.

Abstract

This work introduces a novel approach to the visualization of correlation tables, guided by positive and negative significance thresholds of correlation coefficients. Traditional methods for visualizing correlation matrices often rely on heuristic color schemes, which lack a robust analytical foundation. To address this limitation, we propose a method that constructs and analyzes an ordered sequence of so called momentums, separating positive and negative correlations based on their significance. By leveraging mathematical principles of an optimal solutions, this approach enhances the clarity and interpretability of correlation patterns.

• Item Type: MPRA Paper
• Language: English
• Keywords: correlation, classification, coefficient, defining, sequenc
• Subjects: C - Mathematical and Quantitative Methods > C4 - Econometric and Statistical Methods: Special Topics > C46 - Specific Distributions ; Specific Statistics; C - Mathematical and Quantitative Methods > C6 - Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C63 - Computational Techniques ; Simulation Modeling; C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs > C81 - Methodology for Collecting, Estimating, and Organizing Microeconomic Data ; Data Access

References

1. Davila F., Paz F., Moquillaza A. (2023). Usage and Application of Heatmap Visualizations on Usability User Testing: A Systematic Literature Review. In: Marcus, A., Rosenzweig, E., Soares, M.M. (eds) Design, User Experience, and Usability. HCII 2023. Lecture Notes in Computer Science, vol 14032. Springer, Cham. https://doi.org/10.1007/978-3-031-35702-2_1.

2. Frey, T. and Võhandu, L.K. (1966). Uus Meetod Klassifikatsiooniühikute Püstitatimiseks, Eesti NSV Akadeemia Toimetised, xV Kõide, Bioloogiline Seeria, Nr. 4, 565-576 (Estonian), http://www.datalaundering.com/download/Frey-Vyhandu-RG.pdf (English version)

3. Henderson, H.V. and Velleman, P.F. (1981). Building multiple regression models interactively for statistical analysis and data visualization. Biometrics, 37, 391﷓411.

4. Ishii Aki, Yata Kazuyoshi, Aoshima Makoto (2021). Geometric classifiers for high-dimensional noisy data, Journal of Multivariate Analysis 188 (2022) 104850, https://doi.org/10.1016/j.jmva.2021.104850.

5. Johnstone Iain M. and Titterington D. Michael (2009). Statistical challenges of high-dimensional data, Published: https://doi.org/10.1098/rsta.2009.0159.

6. Jöreskog Karl G. (1978). Structural Analysis of Covariance and Correlation Matrices, Psychometrica, vol. 43, No.4, pp.443-477.

7. Midway Stephen R. (2020). Principles of Effective Data Visualization, Patterns (N Y). Nov 11;1(9):100141, https://pmc.ncbi.nlm.nih.gov/articles/PMC7733875/ .

8. Midway Stephen R. (2020). Principles of Effective Data Visualization, ScienceDirect, Patterns, Volume 1, Issue 9, 11 December 2020, 100141. Principles of Effective Data Visualization - ScienceDirect.

9. Mirkin B.G. (2011). Core Concepts in Data Analysis: Summarization, Correlation, Visualization, Department of Computer Science and Information Systems, Birkbeck, University of London, Malet Street, London WC1E 7Hx UK, Textbook, 426pp, https://link.springer.com/book/10.1007/978-0-85729-287-2 .

10. Mullat J.E. a) (2022). Case Study of Fuel Consumption by Vehicles Utilizing the Postulates of Bounded Rationality, Private Publishing Platform, Monotone Phenomerna of Issues Behind Baragaining Games and Data Analysis, pp.172-191, http://www.datalaundering.com/download/RG-Case-Vehicle-Study.pdf; b) (1971). On a Maximum Principle for Certain Functions of Sets, in “Notes on Data Processing and Functional Analysis”, Proceedings of the Tallinn Polytechnic Institute Series A, No. 313, Tallinn Polytechnic Institute, pp. 37–44, (in Russian), http://www.datalaundering.com/download/RG-193-201-Modular.pdf, (English).

11. Pleil Joachim D., Stiegel Matthew A., Madden Michael C., Sobus Jon R. (2011). Heat map visualization of complex environmental and biomarker measurements. Chemosphere, Volume 84, Issue 5, Pages 716-723. https://doi.org/10.1016/j.chemosphere.2011.03.017.

12. Rozonoer Lev, Mirkin Boris, Muchnik Ilya (2017). Key Ideas from Inception to Current State: International Conference Commemorating the 40th Anniversary of Emmanuil Bravermans Decease, Boston, MA, USA, April 28-30, 2017, Invited Talks

13. Schwabish Jonathan (2021). The Practice of Visual Data Communication: What Works, SageJournals, Volume 22, Issue 3, https://doi.org/10.1177/15291006211057899.

14. Sun Guodao, Zhu Zihao, Zhang Gefei, xu Chaoqing, Wang Yunchao, Zhu Sujia (2023)."Application of Mathematical Optimization in Data Visualization and Visual Analytics: A Survey," in IEEE Transactions on Big Data, vol. 9, no. 4, pp. 1018-1037, https://ieeexplore.ieee.org/document/10081451.

15. Wendy K., Cho Tam, Liu Yan Y. (2018). Sampling from complicated and unknown distributions: Monte Carlo and Markov Chain Monte Carlo methods for redistricting, Physica A: Statistical Mechanics and its Applications, Volume 506, 15 September 2018, Pages 170-178. https://doi.org/10.1016/j.physa.2018.03.096