=== Global edge coupling ===
H(head_glyph) = 3.0905 bits
H(head_glyph | prev_end) = 2.9070 bits
I(head_glyph ; prev_end) = 0.1834 bits
=== Per-stem alteration test (stem_len=1) ===
4775 distinct stems total; 536 testable (>= 5 occurrences, >= 2 distinct head glyphs).
stem — The common word stem by which the tokens were grouped.
n — The number of occurrences of this stem in the corpus.
H_real — How predictable the initial glyph actually is, given the previous final glyph.
H_null_mean — How predictable the initial glyph would be, on average, if there were no real correlation (random reference value).
p(<=real) — The probability that chance alone would yield a value as low as or lower than the actual value.
z — How much the true value deviates from the random mean, measured in standard deviations.
Top25:
stem n H_real H_null_mean p(<=real) z
r 683 1.018 1.082 0.0000 -9.37
kaiin 273 1.253 1.371 0.0000 -5.65
aiin 848 1.417 1.457 0.0000 -4.89
ain 233 1.704 1.801 0.0000 -4.01
ol 309 2.270 2.379 0.0000 -5.34
ar 420 1.748 1.835 0.0000 -5.26
l 741 1.055 1.136 0.0000 -10.98
ly 82 0.603 0.873 0.0000 -8.51
cheey 33 1.704 2.174 0.0000 -4.34
eedy 77 1.370 1.577 0.0000 -3.80
kain 159 1.212 1.338 0.0005 -4.36
dy 73 1.060 1.306 0.0005 -4.54
tey 70 0.418 0.572 0.0005 -4.03
keedy 160 1.235 1.373 0.0005 -5.46
chedy 186 2.078 2.191 0.0005 -3.76
eody 29 0.588 0.929 0.0015 -3.49
m 89 0.663 0.795 0.0020 -3.49
chy 80 2.125 2.325 0.0025 -3.11
dar 31 0.633 0.943 0.0025 -3.37
eey 84 1.545 1.708 0.0040 -3.16
edy 82 1.294 1.425 0.0055 -2.89
hedy 890 0.974 0.985 0.0065 -3.23
iin 479 0.328 0.351 0.0080 -3.00
okeedy 270 0.033 0.064 0.0100 -3.39
kedy 159 1.175 1.251 0.0105 -2.70
23 / 536 stems show head-glyph predictability from prev_end_glyph at p < 0.01 (permutation test).
=== Head-glyph distribution by context, top significant stems ===
Each line in the format after ‘...X’ -> Header1:n1/N, Header2:n2/N, ... shows how often the word stem with a given initial glyph occurs after a token with the final glyph X. The fraction (e.g., 154/244) indicates how often this initial glyph was chosen among all N occurrences in this context. Larger numbers indicate a stronger preference.
Top10:
stem 'r' (n=683, p=0.0000):
after '...r' -> a:154/244, o:89/244, c:1/244
after '...n' -> a:63/115, o:52/115
after '...y' -> o:67/108, a:31/108, l:9/108, v:1/108
after '...l' -> o:57/94, a:36/94, l:1/94
after '...s' -> a:49/70, o:21/70
after '...o' -> a:14/23, o:9/23
after '...d' -> a:9/13, o:4/13
after '...m' -> a:3/5, o:2/5
after '...k' -> o:2/3, a:1/3
after '...p' -> a:2/2
after '...e' -> a:1/1
after '...g' -> a:1/1
after '...h' -> a:1/1
after '...x' -> a:1/1
after '...t' -> a:1/1
after '...a' -> a:1/1
stem 'kaiin' (n=273, p=0.0000):
after '...y' -> o:59/95, l:23/95, y:10/95, e:1/95, a:1/95, d:1/95
after '...n' -> o:56/68, y:8/68, l:2/68, q:1/68, a:1/68
after '...l' -> o:30/43, l:6/43, y:3/43, a:2/43, c:1/43, s:1/43
after '...r' -> o:29/39, y:8/39, l:1/39, a:1/39
after '...o' -> l:9/13, o:4/13
after '...s' -> o:3/7, l:2/7, a:1/7, y:1/7
after '...d' -> o:1/4, a:1/4, s:1/4, y:1/4
after '...m' -> o:1/2, a:1/2
after '...k' -> o:1/1
after '...a' -> l:1/1
stem 'aiin' (n=848, p=0.0000):
after '...y' -> d:291/411, r:38/411, s:33/411, t:18/411, k:17/411, l:7/411, o:4/411, q:2/411, p:1/411
after '...l' -> d:161/224, k:29/224, s:14/224, t:9/224, r:8/224, l:2/224, o:1/224
after '...r' -> d:69/84, k:5/84, o:3/84, s:3/84, r:3/84, l:1/84
after '...n' -> d:62/71, s:6/71, e:1/71, j:1/71, r:1/71
after '...o' -> d:20/38, r:6/38, k:5/38, t:3/38, s:3/38, o:1/38
after '...s' -> d:5/8, o:1/8, s:1/8, k:1/8
after '...a' -> d:3/5, r:2/5
after '...d' -> d:4/4
after '...m' -> d:1/1
after '...h' -> d:1/1
after '...t' -> d:1/1
stem 'ain' (n=233, p=0.0000):
after '...y' -> d:52/103, s:18/103, k:16/103, r:10/103, t:4/103, l:2/103, o:1/103
after '...l' -> d:32/64, k:18/64, s:7/64, r:3/64, o:1/64, j:1/64, t:1/64, l:1/64
after '...n' -> d:26/32, s:3/32, r:1/32, o:1/32, t:1/32
after '...o' -> d:13/16, r:2/16, t:1/16
after '...r' -> d:9/13, s:2/13, k:2/13
after '...s' -> l:1/1
after '...p' -> d:1/1
after '...h' -> t:1/1
after '...a' -> k:1/1
after '...m' -> o:1/1
stem 'ol' (n=309, p=0.0000):
after '...y' -> q:93/202, d:37/202, l:23/202, k:13/202, s:12/202, r:11/202, t:10/202, p:2/202, f:1/202
after '...l' -> d:30/61, q:12/61, k:9/61, t:3/61, l:3/61, s:2/61, r:2/61
after '...o' -> k:3/14, r:3/14, l:2/14, d:2/14, q:2/14, s:1/14, p:1/14
after '...n' -> d:4/14, s:4/14, q:4/14, k:1/14, p:1/14
after '...r' -> k:2/9, d:2/9, t:2/9, s:1/9, q:1/9, l:1/9
after '...s' -> d:2/3, y:1/3
after '...d' -> d:1/2, q:1/2
after '...a' -> m:1/1
after '...e' -> d:1/1
after '...t' -> d:1/1
after '...m' -> q:1/1
stem 'ar' (n=420, p=0.0000):
after '...y' -> d:126/209, s:27/209, k:24/209, t:13/209, r:10/209, l:7/209, f:1/209, p:1/209
after '...l' -> d:62/94, k:14/94, s:6/94, t:5/94, r:4/94, x:1/94, e:1/94, p:1/94
after '...n' -> d:30/42, s:5/42, o:4/42, p:1/42, k:1/42, f:1/42
after '...r' -> d:23/41, t:6/41, k:5/41, s:4/41, f:1/41, m:1/41, o:1/41
after '...o' -> d:16/21, s:2/21, o:1/21, r:1/21, l:1/21
after '...s' -> d:2/5, o:2/5, s:1/5
after '...e' -> d:1/3, k:1/3, s:1/3
after '...d' -> d:1/3, s:1/3, r:1/3
after '...k' -> x:1/1
after '...a' -> k:1/1
stem 'l' (n=741, p=0.0000):
after '...r' -> a:108/216, o:103/216, d:4/216, y:1/216
after '...n' -> o:123/188, a:62/188, d:2/188, c:1/188
after '...y' -> o:105/129, a:16/129, d:4/129, s:1/129, y:1/129, k:1/129, r:1/129
after '...l' -> o:89/118, a:22/118, d:5/118, t:1/118, k:1/118
after '...s' -> a:31/52, o:21/52
after '...o' -> o:7/14, a:6/14, r:1/14
after '...d' -> a:7/12, o:4/12, d:1/12
after '...m' -> o:4/4
after '...t' -> a:2/2
after '...e' -> o:2/2
after '...g' -> o:1/1
after '...p' -> a:1/1
after '...a' -> o:1/1
after '...h' -> o:1/1
stem 'ly' (n=82, p=0.0000):
after '...r' -> a:16/31, o:15/31
after '...y' -> o:16/16
after '...n' -> o:12/15, a:3/15
after '...l' -> o:10/10
after '...s' -> a:5/8, o:3/8
after '...d' -> d:1/1
after '...o' -> o:1/1
stem 'cheey' (n=33, p=0.0000):
after '...y' -> l:9/17, r:4/17, t:2/17, d:1/17, y:1/17
after '...o' -> p:2/7, t:2/7, k:2/7, f:1/7
after '...r' -> f:2/5, o:1/5, k:1/5, y:1/5
after '...l' -> t:1/2, r:1/2
after '...s' -> f:1/1
after '...n' -> o:1/1
stem 'eedy' (n=77, p=0.0000):
after '...l' -> k:24/34, o:4/34, e:3/34, t:3/34
after '...y' -> k:16/32, t:11/32, d:3/32, e:1/32, q:1/32
after '...r' -> e:3/5, o:1/5, k:1/5
after '...e' -> k:2/2
after '...s' -> d:1/1
after '...n' -> o:1/1
after '...o' -> k:1/1
after '...d' -> k:1/1
There really is a connection. The last letter of a word influences which letter the next word starts with. This confirms what the paper found.
But this connection is not a fixed rule, more like a tendency. After a certain letter, a particular starting letter becomes clearly more likely (often 70-80% of the time).
Reliable cases
Stem Context Glyph Fraction Percent
aiin after '...n' d 62/71 87.3%
l after '...y' o 105/129 81.4%
ain after '...n' d 26/32 81.3%
ain after '...o' d 13/16 81.3%
aiin after '...r' d 69/84 82.1%
kaiin after '...n' o 56/68 82.4%
ly after '...n' o 12/15 80.0%
ar after '...o' d 16/21 76.2%
l after '...l' o 89/118 75.4%
kaiin after '...r' o 29/39 74.4%
aiin after '...l' d 161/224 71.9%
ar after '...n' d 30/42 71.4%
aiin after '...y' d 291/411 70.8%
eedy after '...l' k 24/34 70.6%
r after '...s' a 49/70 70.0%
kaiin after '...l' o 30/43 69.8%
r after '...d' a 9/13 69.2%
kaiin after '...o' l 9/13 69.2%
ain after '...r' d 9/13 69.2%
Edit: By definition, the “stem” is simply “whatever remains after the first glyph is removed” (stem_len=1). For a two-letter token like “ar,” the head is ‘a’ and the stem is “r.” That's why we see the individual letters.
Posting the code doesn't make sense with the current forum software.
Well, for example in my Brabantian dialect, there is such a thing. But since the dialect is only spoken (and written informally, and on the decline), this cannot be tested statistically. Anyway, in my spoken dialect, there are three grammatical genders. The gender determines the ending of articles and adjectives (either null, "-e" or "en").
For example:
Masculine: den braven hond (the good dog)
Feminine: de brave kat (the good cat)
However, in the case of the masculine words, whether or not "n" is added also depends on the starting sound of the next word. You get -n before a, b, d, e, i, o, t, u. Also before "h", which is not pronounced so the vowel takes over. So all of the following words are masculine. The presence of "n" in the article only depends on "edge effects":
den aap
den boom
de citroen
den dief
den ezel
de fazant
de gieter
den hond
den iglo
de jacht
de kabouter
de leeuw
de man
de neushoorn
den ooievaar
de paling
de ruiter
de stengel
den tram
den uil
de vos
de wachter
de zager
The edge effects overrules everything, also when there are adjectives involved. To get back to the dog example, we say:
den braven hond
de groten hond
So the word simply looks at its neighbor's starting letter, regardless of the sequence.
Does this explain what we see in the VM? I presume everything in the VM is more extreme. But what it does show is that the principle is not anti-linguistic, even in European languages.