(01-07-2026, 11:25 AM)oshfdk wrote: You are not allowed to view links. Register or Login to view.To my eye about one word in 6 looks weird. Just to make it fair, I didn't cross check with the transliterations, I've just marked below the words that I see as strange. I think there is nothing really wrong with most these words and I bet many of them do appear in the MS occasionally, but generally they look like rare oddities and this text is packed with them.
The generator uses only the "Recipes" section of ZL3b-n.txt for training the model. It should not produce any character 4-gram that doesn't exist in the "Recipes" (Q20) section.
There are 2 ".kas" in ZL3b-n.txt, but they are not in Q20. Weird.
EDIT:
There is ".dal,kasol." in f103r.13 and ".okas." in f115v.40.
Since "." and "," are equivalent:
s = s.replace(/,/g, ".") // uncertain space → word break
".kas." is made of 2 existing 4-grams.
Quote:Also, I'm not sure the end/start pairs (across spaces) look like those in the manuscript.
The words are generated separately in a loop calling genWord(), not taking into account the previously generated words (except when copying or mutating a previous word). With seed = "", ctx is always the same (= PAD).
Code:
const PAD = "^".repeat(order)
...
function genWord(seed = ""): string {
let w = seed
let ctx = (PAD + seed).slice(-order)