(09-08-2026, 04:26 PM)dfs346 Wrote: You are not allowed to view links. Register or Login to view.more on alternative transliterations, the top twenty "words", and the Persian dimension ...
I think your efforts are wasted, and I suppose you know why I think so.
Apart from that, I see two problems with your approach: (1) you are treating the whole book as if it was a homogeneous text, and (2) you are comparing word frequencies with texts of the wrong type.
As for (1), even though the language seems to be basically the same throughout, the VMS is visibly at least four separate books on very different subjects: Herbal+Pharma, Astro+Cosmo+Zodiac, BioBalneo, and Starred Parags (Recipes). Apart form the structure of the tokens, there is no evidence of any discourse thread spanning across sections. Like many books of the time, each of these sections is probably a transcription or translation of a separate "ur-book", possibly by a different author and from a different time and place; each with its own style, emphasis, etc. And Herbal may be a merge of two independent "ur-books", namely Herbal-A and Herbal-B.
But then each section will have its "most common words" that are specific to that section. Even basic function words like "and" and "is" can vary substantially in frequency between a herbal and a list of recipes, between a text on anatomy and a manual of astrology...
As for (2), the contents of each section of the VMS (except perhaps BioBalneo) is not going to be a discursive text, like the typical theology or philosophy treatise. Its sentence structure is likely to be rather constrained and formulaic. We don't expect nontrivial subordinate clauses or logical arguments. Each section will have a specific set of frequent nouns, adjectives, verbs, and verb tenses. Thus, when trying to match common words, you should try to use a reference text that is likely to have the same "technical" style.
And even then you must be aware that two books on the same "technical" subject may have very different styles. For instance, Culpeper's herbal tells many random stories about each plant, so it ends being similar to a discursive treatise; whereas the
Alchemists Herbal is completely different, with very rigid and terse "formulas".
All the best, --stolfi