[split] (lack of) word groups
#31
(03-07-2019, 03:16 PM)Koen G wrote: You are not allowed to view links. Register or Login to view.
I collected some numbers already, you can see them here (final sheet xMATTR):
You are not allowed to view links. Register or Login to view.

Of the texts I checked so far, here's the percentage that have no repeating strings of the following lengths:

2: 1% 
3: 6% 
4: 20% 
5: 32% 
6: 48% 

So about half of these texts never repeat a string of 6 words exactly (taking into account the 1000-word window I always used, which seems reasonably large). 
What may be more interesting is that 9 of my txt files never even repeat a 4-word string. 


Additionally, one file (attached) does apparently not even repeat 3-word strings. It's only 1762 words, which might explain a bit.

Still, I would seriously question the claim that natural languages cannot be without repeating "phrases". If the phrase is 4 words long, I have 9 counterexamples. Make the phrase 5 words long and 20% of checked texts don't repeat any.


Attached Files
.txt   092.AltaSilva.txt (Size: 11.68 KB / Downloads: 19)
[+] 1 user says Thank You to Koen G for this post
Reply


Messages In This Thread
[split] (lack of) word groups - by -JKP- - 01-07-2019, 12:07 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 10:54 AM
RE: [split] (lack of) word groups - by nablator - 03-07-2019, 11:11 AM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 03:16 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 04:15 PM
RE: [split] (lack of) word groups - by Torsten - 03-07-2019, 06:00 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 04:49 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 06:16 PM
RE: [split] (lack of) word groups - by Torsten - 03-07-2019, 07:44 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 08:00 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 08:49 PM
RE: [split] (lack of) word groups - by Torsten - 03-07-2019, 09:14 PM
RE: [split] (lack of) word groups - by Koen G - 03-07-2019, 09:27 PM
[split] (lack of) word groups - by nablator - 01-07-2019, 12:12 PM
RE: [split] (lack of) word groups - by Koen G - 01-07-2019, 05:13 PM
RE: [split] (lack of) word groups - by Koen G - 01-07-2019, 05:26 PM
RE: [split] (lack of) word groups - by Torsten - 01-07-2019, 05:35 PM
RE: [split] (lack of) word groups - by Koen G - 01-07-2019, 05:57 PM
RE: [split] (lack of) word groups - by Torsten - 01-07-2019, 06:04 PM
RE: [split] (lack of) word groups - by MarcoP - 01-07-2019, 06:13 PM
RE: [split] (lack of) word groups - by Koen G - 01-07-2019, 06:27 PM
RE: [split] (lack of) word groups - by Torsten - 01-07-2019, 07:06 PM
RE: [split] (lack of) word groups - by Koen G - 01-07-2019, 07:12 PM
RE: [split] (lack of) word groups - by Torsten - 01-07-2019, 07:25 PM
RE: [split] (lack of) word groups - by nablator - 01-07-2019, 09:03 PM
RE: [split] (lack of) word groups - by Koen G - 02-07-2019, 09:16 AM
RE: [split] (lack of) word groups - by Koen G - 02-07-2019, 10:12 AM
RE: [split] (lack of) word groups - by nablator - 02-07-2019, 11:42 AM
RE: [split] (lack of) word groups - by Koen G - 02-07-2019, 11:55 AM
RE: [split] (lack of) word groups - by nablator - 02-07-2019, 12:08 PM
RE: [split] (lack of) word groups - by Koen G - 02-07-2019, 10:06 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [split] (lack of) scribal mistakes / corrections -JKP- 88 73,962 29-03-2026, 10:14 PM
Last Post: Torsten
  [split] Word length autocorrelation ReneZ 22 10,908 06-09-2025, 11:13 AM
Last Post: Jorge_Stolfi
  [split] Percentage of word types that occur more than once bi3mw 37 34,815 25-06-2020, 05:41 PM
Last Post: Torsten
  [split] Line padding, layout, Currier's "groups of letters"... Torsten 37 38,671 16-03-2020, 06:33 AM
Last Post: Wladimir D
  [split] recurring word sequences doranchak 7 11,772 06-04-2018, 12:16 PM
Last Post: MarcoP

Forum Jump:


Users browsing this thread: 1 Guest(s)