[Article] The Linguistics of the Voynich Manuscript (Bowern et al. 2020)
#42
I have checked the cleaning script. The unusual high number of word repeats is obviously the result of an incomplete cleaning process.

For instance the Wikipedia website You are not allowed to view links. Register or Login to view. contains the following code fragment:
Code:
<table border="1" align="right" cellpadding="4" cellspacing="0" width="300" style="margin: 0 0 1em 1em; background: #f9f9f9; border: 1px #aaaaaa solid; border-collapse: collapse; font-size: 95%;">

The raw files are cleaned by using the following script You are not allowed to view links. Register or Login to view.
Code:
delete_uncommon_chars(doc) # Delete characters with freq < .0001 replace (border))? align ((left)|(right)|(center) with '' replace (cellpadding) with '' replace (cellspacing) with '' replace (width style margin em em background) with '' replace (border collapse collapse) with ''

The result is
Code:
f f f border aaaaaa solid font size
 
see You are not allowed to view links. Register or Login to view.
[+] 1 user says Thank You to lurker for this post
Reply


Messages In This Thread
RE: The Linguistics of the Voynich Manuscript (Bowern et al. 2020) - by lurker - 18-01-2021, 09:33 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [Article] Lindemann and Bowern (2020) is available cbowern 15 20,154 09-06-2021, 07:32 PM
Last Post: Torsten
  [Article] Review on "The Linguistics of the Voynich Manuscript" Torsten 10 25,438 20-03-2021, 08:49 PM
Last Post: Koen G

Forum Jump:


Users browsing this thread: 1 Guest(s)