sh_ and ch_ compose the same words

[farmerjohn]

While I understand the usefulness of percentages in removing the spurious correlation induced by varying page-lengths, I second Torsten's question. I am also interested in understanding what can be the meaning of overall correlation being greater than that of the individual sections.

The reason overall correlation is greater is that the line is defined mostly by the extreme points from the biological section.
Torsten is correct in stating that the calculation of R assumes that the data is normally distributed. Of course that rarely happens which is one reason why this is not a good statistic to calculate in these very non-normal circumstances.

The calculation of correlation doesn't require normality, it only requires that the data is not constant. The interpretation and analysis of result is discussed You are not allowed to view links. Register or Login to view.. In our case it's perfectly applicable, I think.

The important thing however is that the correlation value itself says a little. Is value 0.5 high or low? To deal with it one must also calculate correlation between other types of words. And if one thinks that EVA-sh and EVA-ch are the same based on correlation values, he must be very cunning when explaining almost equally high correlation coefficient for EVA-ok and EVA-qok