[Article] The Linguistics of the Voynich Manuscript (Bowern et al. 2020)

[lurker]

This is a simple test for scanning smaller files for string duplicates: 

Code:

grep -Eo '(\b.+) \1\b' filename | sort | uniq -u

This is the outcome for the Zhuang text sample: 

Code:

#grep -Eo '(\b.+) \1\b' Zhuang | sort | uniq -u aen aen aen gauqbaiq neix aen gauqbaiq neix alfabeto de esperanto alfabeto de esperanto b b b b b b b b b b bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar bar borassus flabellifer borassus flabellifer bouxcuengh bouxcuengh breinigerberg breinigerberg byamanh caethwk nduk byamanh caethwk nduk c c ch chinese only chinese only cm cm cm kwk cm kwk d d d d d d daeuj soebsoeb daeuj soebsoeb deborah read read deborah read read diet diet documents documents doengz doengz dwg dwg eiqceiq eiqceiq em em feihcouh feihcouh fouz fouz geux satsat geux satsat ginghciyoz veizgvanh ginghciyoz veizgvanh grasslands grasslands guinea guinea gwn duh ceuj gwn duh ceuj gyoepsuenq gyoepsuenq h h h h h h h h h h hanciuz hanciuz hoi dou lu vei hoi dou lu vei hojceh hojceh hungzgvanh ginghciyoz hungzgvanh ginghciyoz ij dawz ij dawz in netherlands in netherlands isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn isbn kbs kbs km h km h km h km h km km km km km straße gelände km straße gelände km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² km² l l liuzgiuzgoz liuzgiuzgoz male on maldives male on maldives mauz cwzdungh mauz cwzdungh mbouj naih law mbouj naih law mingzciuz mingzciuz mm mm mm mm mm mm mm mm wannenpanze monte aguila inauguracion nueva plaza de monte aguila inauguracion nueva plaza de mwngz gvai ha mwngz gvai ha n n n n n n n n n n nantucket nantucket nanz lai nienz nyied hauh nienz nienz nyied nienz nyied no no ouhcouh ouhcouh penicillus penicillus ps ps ps ps ps t ps t ps t ps t ps t ps t right right sanskrit sanskrit saw doj saw doj swiq swiq t t t t the supernova the supernova tomislav nikoli tomislav nikoli tundra tundra v v vangz yenfanh vangz yenfanh vaƅ vaƅ voltaire voltaire whitefield whitefield whitefield whitefield yahvaiz yahvaiz yesu yesu yienghndang yienghndang yienzbit yienzbit zylinder ottomotor zylinder dieselmotor zylinder ottomotor zylinder dieselmotor

This outcome illustrates that most duplicated strings did not belong to the Zhuang language.