Vocabulary size by Illustration Type
#12
(05-07-2022, 08:26 PM)Bernd wrote: You are not allowed to view links. Register or Login to view.Large differences in sample text size are certainly a problem but it can be addressed by subsampling.

You can split each section into chunks of ~1000 vords each (maybe rounded to full pages) to match text length to the smallest and 2nd smallest ones (Astro and Zodiac).

Yes, this is a valid approach statistically, but of course it weakens the statistics of the larger sections.
It also removes the meaning of the idea of a 'corpus'.
Reply


Messages In This Thread
Vocabulary size by Illustration Type - by RobGea - 03-07-2022, 03:30 PM
RE: Vocabulary size by Illustration Type - by ReneZ - 05-07-2022, 09:04 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  The rate of vocabulary growth as the content type marker Anton 5 8,545 20-09-2019, 11:02 AM
Last Post: -JKP-

Forum Jump:


Users browsing this thread: