[split] Word length autocorrelation
#16
(05-09-2025, 07:03 PM)nablator wrote: You are not allowed to view links. Register or Login to view.I think we mean the same but use different words. Smile

By bigram I mean word bigram, not character bigram. The autocorrelation (positive or negative) is a property of a word bigram. So I am counting how many of these bigrams (sequences of two words on the same line, no word bigram across lines) are positively autocorrelated = p and how many are negatively correlated = n. The result is (p-n)/(p+n) = 0.169

Hi nablator,
Thanks: using your method (p−n)/(p+n)(p-n)/(p+n)(p−n)/(p+n) I also get about 0.19, close to your result.
The difference is that I usually work with Pearson autocorrelation line by line, which gives mostly negative values (like natural languages). But when computed on the whole corpus, Pearson turns positive, in line with Gaskell & Bowern (around 0.16).

So the surprising part is really this:
  • Line level: negative, natural-like.
  • Corpus level: positive, gibberish-like.
That contrast seems to be a key feature of Voynichese.That contrast seems to be a key feature of Voynichese.

(05-09-2025, 07:06 PM)Jorge_Stolfi wrote: You are not allowed to view links. Register or Login to view.One complication for this sort of analysis is that in the available transcriptions there are many uncertain spaces (EVA comma) that may or may not be word breaks.  And there are many spaces in the text that are wider than normal inter-glyph spaces but narrower than normal inter-word spaces, which transcribers may have either entered as word breaks (EVA period) or just ignored.  

Many of these dubious word breaks are after a short prefix like y or ol or before a short suffix like dy or ar.  If those dubious spaces were treated as word breaks, the length correlation would probably drop, possibly even becoming negative.

All the best, --jorge

You’re right, there are definitely uncertainties in the transcriptions (commas, periods, ambiguous spaces). That could affect the exact values of word-length correlation.

But since I’m calculating autocorrelation line by line, those local errors should average out and not flip the overall sign. In other words, they might shift the correlation slightly, but they wouldn’t normally turn a negative profile into a positive one.

That’s why the contrast between line-level (negative) and whole-corpus (positive) looks "robust", even allowing for those transcription issues.
Reply


Messages In This Thread
[split] Word length autocorrelation - by ReneZ - 05-09-2025, 12:27 AM
RE: [split] Word length autocorrelation - by quimqu - 05-09-2025, 07:37 PM
RE: Can LAAFU effects be modeled? - by quimqu - 05-09-2025, 07:30 AM
RE: Can LAAFU effects be modeled? - by MarcoP - 05-09-2025, 07:57 AM
RE: Can LAAFU effects be modeled? - by nablator - 05-09-2025, 12:20 PM
RE: Can LAAFU effects be modeled? - by quimqu - 05-09-2025, 12:49 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  About word length distribution tikonen 32 18,870 09-05-2025, 05:04 PM
Last Post: Bluetoes101
  Relationship between word frequency and word length Addsamuels 3 6,155 01-10-2023, 03:53 PM
Last Post: ReneZ
  [split] Percentage of word types that occur more than once bi3mw 37 34,242 25-06-2020, 05:41 PM
Last Post: Torsten
  [split] (lack of) word groups -JKP- 39 35,920 03-07-2019, 09:27 PM
Last Post: Koen G
  [split] recurring word sequences doranchak 7 11,619 06-04-2018, 12:16 PM
Last Post: MarcoP

Forum Jump:


Users browsing this thread: 1 Guest(s)