03-05-2022, 07:19 PM
If h1 measures the median, or frequency of appearence, then removing the spaces will only remove the far right data point (I assume that space will be the most popular character by far in all texts).
(The median is the middle number in a sorted, ascending or descending, list of numbers. )
So what we seem to be looking at is that spaces in the Vm corpus function in a similar fashion to those in vernacular texts. IE, there are lots of them. Removing them forces every text up the graph by the same relative amount.
BTW, did you see this article on the entropy of word ordering across linguistic families? Can you do something similar with the VM and see if you can fit it into their results?
You are not allowed to view links. Register or Login to view.
(The median is the middle number in a sorted, ascending or descending, list of numbers. )
So what we seem to be looking at is that spaces in the Vm corpus function in a similar fashion to those in vernacular texts. IE, there are lots of them. Removing them forces every text up the graph by the same relative amount.
BTW, did you see this article on the entropy of word ordering across linguistic families? Can you do something similar with the VM and see if you can fit it into their results?
You are not allowed to view links. Register or Login to view.