2026-04-29T05:03:15Zhttps://uvadoc.uva.es/oai/request

oai:uvadoc.uva.es:10324/842862026-04-24T19:00:35Zcom_10324_1132com_10324_931com_10324_894col_10324_1205

2026-04-23T19:28:47Z urn:hdl:10324/84286 Real significance in large datasets: the similarity structure, a general method to assess the effect size beyond p-value Diez Hermano, Sergio Sánchez Jiménez, Abel Aparicio Rodríguez, Gonazalo Manubens, Paloma Calvo Tapia, Carlos Villacorta Atienza, José Antonio Producción Científica Statistical inference often relies on p-values to test the absence of effects, but in large datasets, even negligible differences become significant. Evaluating the practical, biological, or clinical magnitude of effects therefore becomes essential. Standardized measures, like Cohen’s d, enable broad comparisons but can obscure practical meaning, like dimensional metrics, such as confidence intervals, which in addition lack standardization. We introduce the similarity structure, a general framework that estimates the probability distribution of sizes of similar subsamples. This method is applicable to any data type, dimensionality or statistical test, and quantifies the effect size as the expected number of observations under similarity, providing a practical interpretation in terms of experimental effort, and extends Cohen’s d effect sizes to parameters beyond the mean. The method also enables the comparison of effect sizes –within the same study or across studies–through direct statistical inference, clarifying the relevance of observed differences. The similarity structure, applied here to real datasets, offers a general, transparent and versatile approach for interpreting and comparing effects in large-sample studies. 2026-04-23T19:28:47Z 2026-04-23T19:28:47Z 2026 info:eu-repo/semantics/article PNAS Nexus (en revisión, preprint) https://uvadoc.uva.es/handle/10324/84286 eng info:eu-repo/semantics/openAccess http://creativecommons.org/licenses/by-nc/4.0/ Atribución-NoComercial 4.0 Internacional PNAS