[split] Percentage of word types that occur more than once
#17
(23-06-2020, 11:16 AM)Stephen Carlson wrote: You are not allowed to view links. Register or Login to view.
(22-06-2020, 04:07 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.For these two points, I can recommend to look at Table 3 on You are not allowed to view links. Register or Login to view. , that shows a great spread in the number of unique words (word types).
From the linked page:
Quote:A representative number of word types may be 9,000 - 10,000.
This strikes me on the high side, at least for certain languages and genres.

It's a kind of obvious test, but as anyone compared the unique word count of the VM to that of other works of various languages? This page here You are not allowed to view links. Register or Login to view. puts the number of words per unique words of 7 different English-language novels as between 9 and 16.5. If I understand the VM stats right, it comes in between 3.6 and 4.3, depending on the transcription. It seems that number of unique words in the denominator is about three or four times too high, but I'm curious about non-English works.


This is also not unusual, at least not for non-English works... I found that the Swedish novel Inferno by August Strindberg has a number of 4.38 (total number of words about 46 000).
Reply


Messages In This Thread
RE: [split] Percentage of word types that occur more than once - by Alin_J - 23-06-2020, 04:50 PM
RE: General chat thread - by RobGea - 21-06-2020, 09:55 PM
RE: General chat thread - by bi3mw - 21-06-2020, 11:52 PM
RE: General chat thread - by Emma May Smith - 22-06-2020, 01:28 PM
RE: General chat thread - by Ruby Novacna - 22-06-2020, 01:31 PM
RE: General chat thread - by ReneZ - 22-06-2020, 04:07 PM
RE: General chat thread - by Ruby Novacna - 22-06-2020, 10:31 PM
RE: General chat thread - by Stephen Carlson - 23-06-2020, 11:16 AM
RE: General chat thread - by bi3mw - 23-06-2020, 12:24 PM
RE: General chat thread - by Stephen Carlson - 23-06-2020, 01:12 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [split] Word length autocorrelation ReneZ 22 10,532 06-09-2025, 11:13 AM
Last Post: Jorge_Stolfi
  [split] (lack of) word groups -JKP- 39 35,920 03-07-2019, 09:27 PM
Last Post: Koen G
  [split] recurring word sequences doranchak 7 11,615 06-04-2018, 12:16 PM
Last Post: MarcoP

Forum Jump:


Users browsing this thread: