[Article] A Glyph Is Not a Letter, a Token Is Not a Word, a Space Is Not a Space
#4
=== Global edge coupling ===
H(head_glyph)              = 3.0905 bits
H(head_glyph | prev_end)  = 2.9070 bits
I(head_glyph ; prev_end)  = 0.1834 bits

=== Per-stem alteration test (stem_len=1) ===
4775 distinct stems total; 536 testable (>= 5 occurrences, >= 2 distinct head glyphs).

stem — The common word stem by which the tokens were grouped.

n — The number of occurrences of this stem in the corpus.

H_real — How predictable the initial glyph actually is, given the previous final glyph.

H_null_mean — How predictable the initial glyph would be, on average, if there were no real correlation (random reference value).

p(<=real) — The probability that chance alone would yield a value as low as or lower than the actual value.

z — How much the true value deviates from the random mean, measured in standard deviations.

Top25:
stem            n    H_real  H_null_mean  p(<=real)      z
r              683    1.018        1.082      0.0000  -9.37
kaiin          273    1.253        1.371      0.0000  -5.65
aiin          848    1.417        1.457      0.0000  -4.89
ain            233    1.704        1.801      0.0000  -4.01
ol            309    2.270        2.379      0.0000  -5.34
ar            420    1.748        1.835      0.0000  -5.26
l              741    1.055        1.136      0.0000  -10.98
ly              82    0.603        0.873      0.0000  -8.51
cheey          33    1.704        2.174      0.0000  -4.34
eedy            77    1.370        1.577      0.0000  -3.80
kain          159    1.212        1.338      0.0005  -4.36
dy              73    1.060        1.306      0.0005  -4.54
tey            70    0.418        0.572      0.0005  -4.03
keedy          160    1.235        1.373      0.0005  -5.46
chedy          186    2.078        2.191      0.0005  -3.76
eody            29    0.588        0.929      0.0015  -3.49
m              89    0.663        0.795      0.0020  -3.49
chy            80    2.125        2.325      0.0025  -3.11
dar            31    0.633        0.943      0.0025  -3.37
eey            84    1.545        1.708      0.0040  -3.16
edy            82    1.294        1.425      0.0055  -2.89
hedy          890    0.974        0.985      0.0065  -3.23
iin            479    0.328        0.351      0.0080  -3.00
okeedy        270    0.033        0.064      0.0100  -3.39
kedy          159    1.175        1.251      0.0105  -2.70

23 / 536 stems show head-glyph predictability from prev_end_glyph at p < 0.01 (permutation test).

=== Head-glyph distribution by context, top significant stems ===

Each line in the format after ‘...X’ -> Header1:n1/N, Header2:n2/N, ... shows how often the word stem with a given initial glyph occurs after a token with the final glyph X. The fraction (e.g., 154/244) indicates how often this initial glyph was chosen among all N occurrences in this context. Larger numbers indicate a stronger preference.

Top10:
stem 'r' (n=683, p=0.0000):
  after '...r' -> a:154/244, o:89/244, c:1/244
  after '...n' -> a:63/115, o:52/115
  after '...y' -> o:67/108, a:31/108, l:9/108, v:1/108
  after '...l' -> o:57/94, a:36/94, l:1/94
  after '...s' -> a:49/70, o:21/70
  after '...o' -> a:14/23, o:9/23
  after '...d' -> a:9/13, o:4/13
  after '...m' -> a:3/5, o:2/5
  after '...k' -> o:2/3, a:1/3
  after '...p' -> a:2/2
  after '...e' -> a:1/1
  after '...g' -> a:1/1
  after '...h' -> a:1/1
  after '...x' -> a:1/1
  after '...t' -> a:1/1
  after '...a' -> a:1/1

stem 'kaiin' (n=273, p=0.0000):
  after '...y' -> o:59/95, l:23/95, y:10/95, e:1/95, a:1/95, d:1/95
  after '...n' -> o:56/68, y:8/68, l:2/68, q:1/68, a:1/68
  after '...l' -> o:30/43, l:6/43, y:3/43, a:2/43, c:1/43, s:1/43
  after '...r' -> o:29/39, y:8/39, l:1/39, a:1/39
  after '...o' -> l:9/13, o:4/13
  after '...s' -> o:3/7, l:2/7, a:1/7, y:1/7
  after '...d' -> o:1/4, a:1/4, s:1/4, y:1/4
  after '...m' -> o:1/2, a:1/2
  after '...k' -> o:1/1
  after '...a' -> l:1/1

stem 'aiin' (n=848, p=0.0000):
  after '...y' -> d:291/411, r:38/411, s:33/411, t:18/411, k:17/411, l:7/411, o:4/411, q:2/411, p:1/411
  after '...l' -> d:161/224, k:29/224, s:14/224, t:9/224, r:8/224, l:2/224, o:1/224
  after '...r' -> d:69/84, k:5/84, o:3/84, s:3/84, r:3/84, l:1/84
  after '...n' -> d:62/71, s:6/71, e:1/71, j:1/71, r:1/71
  after '...o' -> d:20/38, r:6/38, k:5/38, t:3/38, s:3/38, o:1/38
  after '...s' -> d:5/8, o:1/8, s:1/8, k:1/8
  after '...a' -> d:3/5, r:2/5
  after '...d' -> d:4/4
  after '...m' -> d:1/1
  after '...h' -> d:1/1
  after '...t' -> d:1/1

stem 'ain' (n=233, p=0.0000):
  after '...y' -> d:52/103, s:18/103, k:16/103, r:10/103, t:4/103, l:2/103, o:1/103
  after '...l' -> d:32/64, k:18/64, s:7/64, r:3/64, o:1/64, j:1/64, t:1/64, l:1/64
  after '...n' -> d:26/32, s:3/32, r:1/32, o:1/32, t:1/32
  after '...o' -> d:13/16, r:2/16, t:1/16
  after '...r' -> d:9/13, s:2/13, k:2/13
  after '...s' -> l:1/1
  after '...p' -> d:1/1
  after '...h' -> t:1/1
  after '...a' -> k:1/1
  after '...m' -> o:1/1

stem 'ol' (n=309, p=0.0000):
  after '...y' -> q:93/202, d:37/202, l:23/202, k:13/202, s:12/202, r:11/202, t:10/202, p:2/202, f:1/202
  after '...l' -> d:30/61, q:12/61, k:9/61, t:3/61, l:3/61, s:2/61, r:2/61
  after '...o' -> k:3/14, r:3/14, l:2/14, d:2/14, q:2/14, s:1/14, p:1/14
  after '...n' -> d:4/14, s:4/14, q:4/14, k:1/14, p:1/14
  after '...r' -> k:2/9, d:2/9, t:2/9, s:1/9, q:1/9, l:1/9
  after '...s' -> d:2/3, y:1/3
  after '...d' -> d:1/2, q:1/2
  after '...a' -> m:1/1
  after '...e' -> d:1/1
  after '...t' -> d:1/1
  after '...m' -> q:1/1

stem 'ar' (n=420, p=0.0000):
  after '...y' -> d:126/209, s:27/209, k:24/209, t:13/209, r:10/209, l:7/209, f:1/209, p:1/209
  after '...l' -> d:62/94, k:14/94, s:6/94, t:5/94, r:4/94, x:1/94, e:1/94, p:1/94
  after '...n' -> d:30/42, s:5/42, o:4/42, p:1/42, k:1/42, f:1/42
  after '...r' -> d:23/41, t:6/41, k:5/41, s:4/41, f:1/41, m:1/41, o:1/41
  after '...o' -> d:16/21, s:2/21, o:1/21, r:1/21, l:1/21
  after '...s' -> d:2/5, o:2/5, s:1/5
  after '...e' -> d:1/3, k:1/3, s:1/3
  after '...d' -> d:1/3, s:1/3, r:1/3
  after '...k' -> x:1/1
  after '...a' -> k:1/1

stem 'l' (n=741, p=0.0000):
  after '...r' -> a:108/216, o:103/216, d:4/216, y:1/216
  after '...n' -> o:123/188, a:62/188, d:2/188, c:1/188
  after '...y' -> o:105/129, a:16/129, d:4/129, s:1/129, y:1/129, k:1/129, r:1/129
  after '...l' -> o:89/118, a:22/118, d:5/118, t:1/118, k:1/118
  after '...s' -> a:31/52, o:21/52
  after '...o' -> o:7/14, a:6/14, r:1/14
  after '...d' -> a:7/12, o:4/12, d:1/12
  after '...m' -> o:4/4
  after '...t' -> a:2/2
  after '...e' -> o:2/2
  after '...g' -> o:1/1
  after '...p' -> a:1/1
  after '...a' -> o:1/1
  after '...h' -> o:1/1

stem 'ly' (n=82, p=0.0000):
  after '...r' -> a:16/31, o:15/31
  after '...y' -> o:16/16
  after '...n' -> o:12/15, a:3/15
  after '...l' -> o:10/10
  after '...s' -> a:5/8, o:3/8
  after '...d' -> d:1/1
  after '...o' -> o:1/1

stem 'cheey' (n=33, p=0.0000):
  after '...y' -> l:9/17, r:4/17, t:2/17, d:1/17, y:1/17
  after '...o' -> p:2/7, t:2/7, k:2/7, f:1/7
  after '...r' -> f:2/5, o:1/5, k:1/5, y:1/5
  after '...l' -> t:1/2, r:1/2
  after '...s' -> f:1/1
  after '...n' -> o:1/1

stem 'eedy' (n=77, p=0.0000):
  after '...l' -> k:24/34, o:4/34, e:3/34, t:3/34
  after '...y' -> k:16/32, t:11/32, d:3/32, e:1/32, q:1/32
  after '...r' -> e:3/5, o:1/5, k:1/5
  after '...e' -> k:2/2
  after '...s' -> d:1/1
  after '...n' -> o:1/1
  after '...o' -> k:1/1
  after '...d' -> k:1/1


There really is a connection. The last letter of a word influences which letter the next word starts with. This confirms what the paper found.
But this connection is not a fixed rule, more like a tendency. After a certain letter, a particular starting letter becomes clearly more likely (often 70-80% of the time).

Reliable cases
Stem Context Glyph Fraction Percent
aiin after '...n' d 62/71 87.3%
l after '...y' o 105/129 81.4%
ain after '...n' d 26/32 81.3%
ain after '...o' d 13/16 81.3%
aiin after '...r' d 69/84 82.1%
kaiin after '...n' o 56/68 82.4%
ly after '...n' o 12/15 80.0%
ar after '...o' d 16/21 76.2%
l after '...l' o 89/118 75.4%
kaiin after '...r' o 29/39 74.4%
aiin after '...l' d 161/224 71.9%
ar after '...n' d 30/42 71.4%
aiin after '...y' d 291/411 70.8%
eedy after '...l' k 24/34 70.6%
r after '...s' a 49/70 70.0%
kaiin after '...l' o 30/43 69.8%
r after '...d' a 9/13 69.2%
kaiin after '...o' l 9/13 69.2%
ain after '...r' d 9/13 69.2%



Edit: By definition, the “stem” is simply “whatever remains after the first glyph is removed” (stem_len=1). For a two-letter token like “ar,” the head is ‘a’ and the stem is “r.” That's why we see the individual letters.

Posting the code doesn't make sense with the current forum software.
Reply


Messages In This Thread
RE: A Glyph Is Not a Letter, a Token Is Not a Word, a Space Is Not a Space - by bi3mw - 21-08-2026, 01:25 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [Article] Glyph combinations across word breaks in the Voynich Manuscript Emma May Smith 36 43,928 28-10-2024, 07:10 PM
Last Post: Barbrey

Forum Jump:


Users browsing this thread: