26-12-2020, 10:55 AM
Apparently, there is a problem with some of the texts.
I first spotted this on the Italian text by Brunetto Latini. The text comes from here:
You are not allowed to view links. Register or Login to view.
This is the version in the corpus:
You are not allowed to view links. Register or Login to view.
The problem is that words are joint across lines.
lo quale è ritratto in vulgare
becomes:
lo quale èritratto in vulgare
The problem also affects the Georgian text:
You are not allowed to view links. Register or Login to view.
You are not allowed to view links. Register or Login to view.
When dealing with character entropy (the subject of this paper) the impact will be minimal. But it would be great to have a reliable corpus that can be used for higher level statistics also (e.g. word entropy).
I first spotted this on the Italian text by Brunetto Latini. The text comes from here:
You are not allowed to view links. Register or Login to view.
This is the version in the corpus:
You are not allowed to view links. Register or Login to view.
The problem is that words are joint across lines.
lo quale è ritratto in vulgare
becomes:
lo quale èritratto in vulgare
The problem also affects the Georgian text:
You are not allowed to view links. Register or Login to view.
You are not allowed to view links. Register or Login to view.
When dealing with character entropy (the subject of this paper) the impact will be minimal. But it would be great to have a reliable corpus that can be used for higher level statistics also (e.g. word entropy).


![[+]](https://www.voynich.ninja/images/collapse_collapsed.png)