Generated word tokens from chars ( pairs )

[bi3mw]

I've started an experiment to see if it's possible to generate word tokens from word types under certain conditions. The following conditions must be met:

• The ratio of word types to word tokens should be as similar as possible to the VMS ( as extrapolated ).
  
• The method should be simple enough to use, i. e. conversion to ciphertext and back to plain text should be possible without using a codebook or other tools.
  
• Only character set A-Z and 0-9 was used.
  
• All text should be generated with only one method. Subsequent adjustments were excluded.
  

The wordlist was generated from the "Regimen sanitatis Magnini Mediolanensis (vol. 1)". It contains 5391 words types. The plaintext has 25014 words, the generated text has 23264 word tokens.


Rules:

• The first letter is always single, so "D" is 4.
  
• If char is A-Y then it must be replaced with a number ( A=1, B=2, C=3 ...).
  
• "Z" is space.
  
• If char is a number then no change is needed.
  
• If the second and third chars are "AZ" ( 1 ) then no division or swap is needed ( see  "CAZC" ).
  

The diagram looks like this:


This is the procedure explained by the word "zodiacus":

You are not allowed to view links. Register or Login to view.

Full string: D390ZX0  B36Z36  CAZC  D39IZ30D

First string: D390ZX0

D = 4
3 = 3
9 = 9
0 = 0
Z =  SPACE
X= 24
0 = 0
 
Result: 4 390 240

  ---------    count divisions
 |  |-------------------------------------------------------dividend ( for first number )
 |  |
4 390 240 --------------------------------------------------------------------------basis for division ( / 2 )


Division:
------------

   240
1 120
2 60
3 30
4 15 <= ( divisor for first number )

The second number is 15 = O
390 / 15 = 26
The first number is 26 = Z
Result first letter pair: ZO

Second string: B36Z36

B = 2
3 = 3
6 = 6
Z = SPACE
3 = 3
6 = 6

Result 2 36 36

Division:
------------

    36
1 18
2 9 <= ( divisor )

The second number is 9 = I
36 / 9 = 4
The first number is 4 = D
Result second letter pair: DI

Third string: CAZC

C = 3
A = 1
Z = SPACE
C = 3

Result: 3 1 3 => second is "1" , so no changes are needed ( see above ).

The second number is 3 = C
The first number is 1 = A
Result third letter pair: AC

Fourth string: D39IZ30D

D = 4
3 = 3
9 = 9
I = 9
Z = SPACE
3 = 3
0 = 0
D = 4

Result: 4 399 304

Division:
-----------

     304
1   152
2   76
3   38
4   19 <= ( divisor )

The second number is 19 = S
399 / 19 = 21
The first number is 21 = U
Result fourth letter pair: US

To be clear, i don't know if this procedure shows a similar result for other comparable texts. The table is attached.

You are not allowed to view links. Register or Login to view.