dashstofsk > 17-11-2025, 01:25 AM
(16-11-2025, 09:32 PM)Mark Knowles Wrote: You are not allowed to view links. Register or Login to view.the mental energy and time required to produce the optimal set of filler words might be too costly
Doireannjane > 17-11-2025, 02:01 AM
(17-11-2025, 01:25 AM)dashstofsk Wrote: You are not allowed to view links. Register or Login to view.(16-11-2025, 09:32 PM)Mark Knowles Wrote: You are not allowed to view links. Register or Login to view.the mental energy and time required to produce the optimal set of filler words might be too costly
If you look at the frequencies of the top words in the Bio B2 pages you will be able to see that the top 8 words make up 20% of the text in that section.
ol is the most frequent word ( 4.4% ). If you believe that only 20% of words are real then you will have to believe that ol must be a filler word, otherwise it would form 22% of real words, an unlikely occurrence. But if it is a filler word it would form 5.5% of filler words, 1 in every 18.
By the same logic chedy ( 3.6% ) must also be a filler word, and form 4.5% of filler words, 1 in every 22.
Then Shedy also, a filler. 1 in every 29.
Then qokedy qokain qokeedy. Most probably fillers also. Each, 1 in ~35.
Together these top 6 words, if they are fillers, will form 22% of all filler words. 1 in ~4.6.
I hope you can now see a bit of a problem. Why is there so much ubiquity of these filler words? Anyone really intent on obfuscating the text would have added more variability. Reusing these words so often couldn't have taken the authors much 'mental energy'.
But also there is a further problem. Something more serious for your hypothesis. If the top words are all filler words then once you have eliminated them the frequencies of the remaining words start to flatten. Among them there isn't any dominant common word, none that occurs significantly more than the next common word. In short, the non-filler words will not follow Zipf's law.
So then, since Zipf's law holds for most natural languages, and it won't under your hypothesis, where is your meaningful text?
Mark Knowles > 17-11-2025, 07:51 AM
(17-11-2025, 01:25 AM)dashstofsk Wrote: You are not allowed to view links. Register or Login to view.Why is there so much ubiquity of these filler words? Anyone really intent on obfuscating the text would have added more variability. Reusing these words so often couldn't have taken the authors much 'mental energy'.You are making an assumption that "Anyone really intent on obfuscating the text would have added more variability". I don't think you can make that assumption. Clearly, if the Voynich is written in such a way the author's approach has been successful in obfuscating the text without taking much mental energy.
Mark Knowles > 17-11-2025, 07:55 AM
(17-11-2025, 01:25 AM)dashstofsk Wrote: You are not allowed to view links. Register or Login to view.But also there is a further problem. Something more serious for your hypothesis. If the top words are all filler words then once you have eliminated them the frequencies of the remaining words start to flatten. Among them there isn't any dominant common word, none that occurs significantly more than the next common word. In short, the non-filler words will not follow Zipf's law.
So then, since Zipf's law holds for most natural languages, and it won't under your hypothesis, where is your meaningful text?
Rafal > 17-11-2025, 12:16 PM
Quote:In short, the non-filler words will not follow Zipf's law.
Mark Knowles > 17-11-2025, 12:30 PM
nablator > 17-11-2025, 01:30 PM
(17-11-2025, 12:10 AM)Jorge_Stolfi Wrote: You are not allowed to view links. Register or Login to view.In the case of Voynichese, the entropy per character depends on whether one counts each EVA character as a separate letter, or if one considers each of Ch, Sh, ee, iin, etc to be a single letter.
And one must look at higher-order entropy, at least order 3 or 4 for characters.
R. Sale > 17-11-2025, 09:05 PM