(11-10-2025, 04:13 PM)Jorge_Stolfi wrote: You are not allowed to view links. Register or Login to view.Perhaps one can answer that question by looking at frequencies of pairs of words in consecutive positions. Preferably excluding the first and last words of each line, and the first line of each parag.
If the A/B difference is due to spelling or dialect difference, there should be a roughly 1-1 mapping W -> m(W) between word types. Then it should be possible to match most of the most common word pairs in a way that is consistent with that mapping.
That is, if "W1 W2" is a common pair in language A, then "m(W1) m(W2)" should be common in language B.
Since daiin is the most common word in both A and B, we can start by guessing that m(dain) = daiin. Then we should look for the most common word pairs "daiin W" and "W daiin", and see whether we can guess m(W) for some of those words.
You seem to read my mind
It is exactly what I am doing today. Briefly, I detected the main "languages" (the topic modeling detects 3 different languges, roughly currier A and B and a third one). Then I filter by those main topics (or languages, dialects, whatever you want to name it) and I run new topic detections, but this time, allowing bigrams. The model detects a total of 8 subtopics.Then,once I have those subtopics, I check what happens to the paragraphs if I sort them by subtopic, not knowing their main topics. About 77% is labelled with the same subtopic and main topic as the first round. The rest, are subtopics that I consider cross-language topics.
I will post results in my thread about automatic topic detection.


![[+]](https://www.voynich.ninja/images/collapse_collapsed.png)