Vocabulary size by Illustration Type
#11
(04-07-2022, 03:07 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.Between the two views:

- ignoring sample text length

- dividing by sample text length

both views are imperfect. It is not clear to me which one of the two is the more indicative one.

Certainly, dictionary size increases very non-linearly with sample text size.

It is only a problem when text lenghts are significantly different. That is the case here of course.
Large differences in sample text size are certainly a problem but it can be addressed by subsampling.

You can split each section into chunks of ~1000 vords each (maybe rounded to full pages) to match text length to the smallest and 2nd smallest ones (Astro and Zodiac). This also allows you to test if the differences between sections of different illustration types are significantly larger than within them.

(05-07-2022, 12:16 PM)Torsten wrote: You are not allowed to view links. Register or Login to view.If illustrations do indicate topics, some common terms specific to a particular type of illustration or topic should exist. However such terms doesn't exist.
This hypothesis implies a simple encoding in which 'vords' always translate 1:1 into plaintext words regardless of context, which is highly questionable considering the strange properties of 'Voynichese'. If it was that easy, the VM would have been deciphered long ago.

But still so far there is little (if any?) evidence of a connection between text and imagery. Please correct me if I'm wrong.
Reply


Messages In This Thread
Vocabulary size by Illustration Type - by RobGea - 03-07-2022, 03:30 PM
RE: Vocabulary size by Illustration Type - by Bernd - 05-07-2022, 08:26 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  The rate of vocabulary growth as the content type marker Anton 5 8,545 20-09-2019, 11:02 AM
Last Post: -JKP-

Forum Jump:


Users browsing this thread: