Posts: 2,606Threads: 121 Member details
Posts: 2,606
Threads: 121
Thanks Received: 1,485 in 941 posts
Thanks Given: 1199
Joined: Mar 2017
Reputation:
6
Location: OWL
Country:
11-04-2019, 06:14 PM
(This post was last modified: 11-04-2019, 06:22 PM by bi3mw.)
For some time I have been dealing with a fundamental question. Have you ever tried to use a ( medieval ) corpus to generate text that has similar characteristics to the VMS using cryptographic methods? The horse is saddled here, so to speak, from the other side. I mean no random text, but text that can be decrypted again (meaningful). For example, is it possible to replicate the steep curve of word lengths ? Are immediate,multiple word repetitions possible ?
It is therefore a matter of experimentally replicating the known properties of the VMS with a given corpus ( modeling ). Does that make sense in your opinion or is that too experimental ?
The following 1 user says Thank You to bi3mw for this post:1 user says Thank You to bi3mw for this post
• MarcoP
Posts: 2,260Threads: 23 Member details
Posts: 2,260
Threads: 23
Thanks Received: 1,700 in 1,038 posts
Thanks Given: 2497
Joined: Oct 2017
Reputation:
5
Country:
Quote:Have you ever tried to use a ( medieval ) corpus to generate text that has similar characteristics to the VMS using cryptographic methods?
Yes. Generating encrypted pseudo-Voynichese is very helpful, not only to reassure oneself that the method seems to works, but also to create data for decryption: the result can be checked easily, as the plaintext is known.
Posts: 10,551Threads: 432 Member details
Posts: 10,551
Threads: 432
Thanks Received: 4,959 in 2,819 posts
Thanks Given: 4890
Joined: Mar 2016
Reputation:
11
Country:
So... which steps are certainly required to do it?
Posts: 4,318Threads: 195 Member details
Posts: 4,318
Threads: 195
Thanks Received: 863 in 621 posts
Thanks Given: 908
Joined: Jun 2015
Reputation:
8
Location: Moscow
Country:
I haven't seen even statistical calculations across medieval corpuses of comparable topics. Say, take an early 15th c. German pharmacopaeia and calculate entropies.
This is due to absence of transcriptions, of course.
The following 2 users say Thank You to Anton for this post:2 users say Thank You to Anton for this post
• MarcoP, bi3mw
Posts: 2,606Threads: 121 Member details
Posts: 2,606
Threads: 121
Thanks Received: 1,485 in 941 posts
Thanks Given: 1199
Joined: Mar 2017
Reputation:
6
Location: OWL
Country:
I always use this, cleaned extract from "Regimen sanitatis Magnini Mediolanensis (vol. 1)". Thematically quite appropriate, but an excerpt from a composite manuscript would of course be better
You are not allowed to view links. Register or Login to view.
You are not allowed to view links. Register or Login to view.
Posts: 6,953Threads: 158 Member details
Posts: 6,953
Threads: 158
Thanks Received: 2,004 in 1,498 posts
Thanks Given: 690
Joined: Jan 2016
Reputation:
8
Country:
11-04-2019, 10:30 PM
(This post was last modified: 11-04-2019, 11:09 PM by -JKP-.)
Quote:bi3mw: Have you ever tried to use a ( medieval ) corpus to generate text that has similar characteristics to the VMS using cryptographic methods?
Yes.
The sample I posted in René's thread about generating Voynichese was an attempt (a quick one) to create text using a repeatable, explainable system that resembles Voynichese as closely as possible (I think I could get a little closer if I took more time to polish it), and I'm fairly sure the sample I chose to encrypt was from a medieval text.
Here's the sample I posted. This was generated in about 15 minutes, but I could probably get closer to Voynichese if I took more time:
There is one thing in particular that I was not able to recreate in such a short time that gives away that it is not perfect Voynichese, but since it is natural language and it can be readily decrypted, perhaps it's good enough for the purposes of example.
Posts: 4,318Threads: 195 Member details
Posts: 4,318
Threads: 195
Thanks Received: 863 in 621 posts
Thanks Given: 908
Joined: Jun 2015
Reputation:
8
Location: Moscow
Country:
Hi bi3mw,
This sample still needs some normalization - such as to remove linebreaks and convert all to lowercase (unless we want to count upper and lower as different characters).
If you are interested, I can calculate the entropy values tomorrow, I have Matlab scripts for that. (I could do today, but it's late and I'm going to sleep  )
But I don't expect anything extraordinary here, since the excerpt is already expanded into "normal" Latin. What would be more characteristical and authentic would be to use abbreviated Latin or German example, since that was the way the stuff was written back then.
Posts: 2,606Threads: 121 Member details
Posts: 2,606
Threads: 121
Thanks Received: 1,485 in 941 posts
Thanks Given: 1199
Joined: Mar 2017
Reputation:
6
Location: OWL
Country:
@Anton: Sorry, You are not allowed to view links. Register or Login to view. again the corpus.
Posts: 6,953Threads: 158 Member details
Posts: 6,953
Threads: 158
Thanks Received: 2,004 in 1,498 posts
Thanks Given: 690
Joined: Jan 2016
Reputation:
8
Country:
(11-04-2019, 10:39 PM)Anton wrote: You are not allowed to view links. Register or Login to view....
But I don't expect anything extraordinary here, since the excerpt is already expanded into "normal" Latin. What would be more characteristical and authentic would be to use abbreviated Latin or German example, since that was the way the stuff was written back then.
Yes, good point. It might be a good idea to have both an expanded and abbreviated version in each language.
Posts: 6,953Threads: 158 Member details
Posts: 6,953
Threads: 158
Thanks Received: 2,004 in 1,498 posts
Thanks Given: 690
Joined: Jan 2016
Reputation:
8
Country:
bi3, I've been thinking about Anton's point about abbreviated text.
If there were an alternate text with abbreviations, which ones should they be?
- There were zillions of abbreviations.
- The VMS seems more consistent than inconsistent (there are many common patterns repeated throughout the manuscript).
- Not all scribes abbreviated heavily.
So, my thought was, there were certain abbreviations that almost everyone used. Maybe it would be helpful to have a list of those.
The extremely common ones in numerous languages were
- y (con- com- -us -um)
- p with a strike through the descender (per-)
- p with a loop through the descender (pro-)
- -by (usually stood for -bus)
- dz or bz (rotated "m" that looks like zee usually stood for -em or -um and its homonyms and lazy scribes sometimes used it for -rum)
- 4 ("-rum" symbol is actually an "r" with a fancy tail but looks a bit like a modern 4 with an open top)
- a symbol that looks like 2 (usually superscripted) represented -ur or -tur
- k (abbreviation for Item in Latin, Italian, German, Czech, and English but sometimes meant other things in other languages)
- -ris/-tis/-cis/-gis - this is actually just an -is symbol, a loop with a tail, added to various letters. They resemble VMS g and m.
- The "smoke" symbol (a wiggly, vertical, or hooked macron) usually represented re/er/ir/ri (in early medieval manuscripts this was drawn like an upside-down EVA-l in later medieval, it was like a smoke symbol, a straight macron, or a curved macron, depending on scribe)
- The macron, or curved macron indicated missing letters. There was usually no difference in meaning between straight or curved macrons, scribes did whatever was comfortable to write. The macron most often represented m or n but it could be almost anything, including multiple letters. It could also cut through ascenders.
- The tail was in a sense a connected macron. If the missing letters were near the end of the word, it was easier to draw a tail rather than lifting the pen and drawing a line over the letters.
The Latin language also included the following common ones
- single-or double-character abbreviations for the very common "q" words like qui, quo, quodam, quomodo, quibus, etc., which were usually a q with a strike-through or loop through the stem, a small "o" or the common bz (-bus) ending
Spanish very often included a c or co abbreviation for con (this sometimes shows up in other languages, as well).
.
Even if a scribe used abbreviations sparingly, they usually used the ones above. In fact, y was so common, it was sometimes added to the end of the alphabet in pen tests. Note that it was added to the end of the alphabet on VMS You are not allowed to view links. Register or Login to view. at the bottom of the column text.
There is also evidence in the VMS, that whoever designed appears to have been familiar with 9, m g, macrons, and tail abbreviations (even if they mean something different in the VMS).
This might seem like a lot of abbreviations, but it's actually only a dozen or so that most scribes used fairly consistently even if they didn't use the others.
|