12-09-2016, 10:37 AM
Marco, problem is that you used the TT transcription. This excludes the Rosette page. If you need it, You are not allowed to view links. Register or Login to view..
If you use that as well , you get some different values, that is why i did not compare your list with mine.
If i have some additional time i will publish on that page (scroll down) the unique & compared words compared to the whole text and compared to specific other pages.
This conclusion is wrong with respect to the basic stemming of the words, here considered as labels, change as they become a noun or label.
I wrote this before: the "grammatical case" is in effect when we look at the words. The consequences are that only the stem remains the same.
If you use that as well , you get some different values, that is why i did not compare your list with mine.
If i have some additional time i will publish on that page (scroll down) the unique & compared words compared to the whole text and compared to specific other pages.
(11-09-2016, 12:35 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.Many thanks Marco,
this is indeed a very helpful result.
If 172 labels are not found back in the text, then 332 are. Of these, 70% are found back as a single word separated by spaces, and this is indeed a very high percentage, suggesting that the spaces as we see them in the main text are intentional.
This isn't water-tight proof of course, but very strong evidence.
One has to keep in mind that the list of labels in the MS do not follow Zipf's law at all. While the label words aren't exactly unique, they are "almost unique". Among the labels, there are only few repetitions.
The label words *could* be repetitions of words in the main text, after the text was written with arbitrary space insertion, but then one should not expect such a flat word frequency distribution in the labels.
This conclusion is wrong with respect to the basic stemming of the words, here considered as labels, change as they become a noun or label.
I wrote this before: the "grammatical case" is in effect when we look at the words. The consequences are that only the stem remains the same.