- Options
- Login
- Desktop Style
Options
A mathematical approach to double words, conditional logic and the missing pages
- A mathematical approach to double words, conditional logic and the missing pages
-
RE: A mathematical approach to double words, conditional logic and the missing pages
asteckley > 4 hours ago
(5 hours ago)tavie Wrote: You are not allowed to view links. Register or Login to view.So if you're using a chatbot/LLM like ChatGPT, Claude, or Gemini for your posts here, please use it for strict translation (I presume from Italian to English) of the words you have written, and don't permit it to alter your text any more than that.
Unfortunately such a Ludditian policy is a losing battle. AI-assisted rewriting of emails, articles, forum posts, and general prose is already becoming the norm, and it isn't going away. The tools for it are built-in to most editors at this point.
The real issue isn't whether AI helped polish someone's wording. The issue is whether the post contains clear, honest, substantive reasoning. Bad AI writing should be criticized as bad writing. Empty “AI slop” should called out as empty slop. But treating any AI-assisted wording as unacceptable is an outdated standard that will be impossible to enforce and increasingly detached from how people actually starting to write things now.
Whether we like it or not, the onus is being forced back onto readers, who will have to judge an argument for itself: Is it coherent? Is it supported? Can the person defend its claims? That matters far more than whether a language tool helped clean up the prose, regardless of whether any language translating involved. -
RE: A mathematical approach to double words, conditional logic and the missing pages
ololololo > 4 hours ago
(4 hours ago)asteckley Wrote: You are not allowed to view links. Register or Login to view.
There's nothing wrong with using AI as an auxiliary tool. But if that's the only thing you use, it's a big problem(5 hours ago)tavie Wrote: You are not allowed to view links. Register or Login to view.So if you're using a chatbot/LLM like ChatGPT, Claude, or Gemini for your posts here, please use it for strict translation (I presume from Italian to English) of the words you have written, and don't permit it to alter your text any more than that.
Unfortunately such a Ludditian policy is a losing battle. AI-assisted rewriting of emails, articles, forum posts, and general prose is already becoming the norm, and it isn't going away. The tools for it are built-in to most editors at this point.
The real issue isn't whether AI helped polish someone's wording. The issue is whether the post contains clear, honest, substantive reasoning. Bad AI writing should be criticized as bad writing. Empty “AI slop” should called out as empty slop. But treating any AI-assisted wording as unacceptable is an outdated standard that will be impossible to enforce and increasingly detached from how people actually starting to write things now.
Whether we like it or not, the onus is being forced back onto readers, who will have to judge an argument for itself: Is it coherent? Is it supported? Can the person defend its claims? That matters far more than whether a language tool helped clean up the prose, regardless of whether any language translating involved.
But I don't think this research is dependent on AI, or if it is, it's not a significant factor.
-
RE: A mathematical approach to double words, conditional logic and the missing pages
Vuk88 > 4 hours ago
(8 hours ago)Jorge_Stolfi Wrote: You are not allowed to view links. Register or Login to view.
(9 hours ago)Jorge_Stolfi Wrote: You are not allowed to view links. Register or Login to view.In my transcription of the Starred Parags section ("Quire 20"), these are the string doublets and their frequencies, ignoring spaces and line breaks but not parag breaks: [...]
I re-counted the string doublets in the Starred Parags section after "correcting" m -> iin, ir -> iin, hh -> he. The only significant changes were aiinaiin rising from (4) to (29), and daiindaiin rising from (4) to (10).
The corrected file has N = 56817 EVA letters (including '?'). The string daiin occurs 415 times, and aiin occurs 1774 times (including 415 as part of daiin). By the same reasoning as before, the string doublet aiinaiin should occur ~55 times, so the actual count (29) is a bit too low. The doublet daiindaiin should occur only ~3 times, so the actual count (10) is somewhat notable.
All the best, --stolfi
I'm sure you noticed we got 10 occurrences of daiindaiin. Since basic probability says we should only see about 3, this clearly isn't just random noise.
Doesn't this suggest the text has internal rules forcing these strings together way more often than chance allows?
On the flip side, the exact opposite happens with aiinaiin, which actually makes perfect sense from a linguistic perspective.
When a highly frequent string like aiin actively avoids repeating (we see 29 but expect 55), it usually acts like a connector, article, or preposition. Think of the word 'the' in English: it's everywhere, but you never write 'the the' (unless it’s hidden inside adjacent words, which easily explains those 29 hits).
For me, this backs up the conditional variance I saw in the Python script regarding the active suppression or attraction caused by specific surrounding words. -
RE: A mathematical approach to double words, conditional logic and the missing pages
Mauro > 4 hours ago
-
RE: A mathematical approach to double words, conditional logic and the missing pages
Jorge_Stolfi > 3 hours ago
(4 hours ago)Mauro Wrote: You are not allowed to view links. Register or Login to view.The point raised by @dashstofks in You are not allowed to view links. Register or Login to view. and later @nablator in You are not allowed to view links. Register or Login to view. (on which word is more often duplicated in the text) is yet to be adressed.
I haven't checked the whole VMS, but in the Starred Parags section chol occurs 131 times, cholchol occurs 2 times (expected ~0). As noted above, daiin occurs 415 times and daiindaiin occurs 10 times (expected ~3). Looking for them as strings, ignoring spaces and line breaks but keeping parag breaks, with the three "corrections" mentioned previously.
I think this discrepancy about chol and daiin shows the importance of analyzing each section separately. For all we know, the VMS is a compilation of several separate ur-books, each with specific topic, style, format, etc. As far as we can tell, the only thing in common among all sections is the script and (partly) the language/spelling/encryption, and the fact that they were compiled by the same Author and penned by the same Scribe.
We cannot even assume that the ur-books were composed by the same person or in the same country and century. Herbal-A may be a Basque herbal from the 12th century, while herbal-B may may be a Mingrelian one from the 10th, both translated into Voynichese and merged by the Author into a single herbal.
Anyway, the great differences in topic and format alone should cause most statistics to differ from section to section. Statistics computed over the whole VMS are likely to be more confusing than illuminating.
All the best, --stolfi -
RE: A mathematical approach to double words, conditional logic and the missing pages
Aga Tentakulus > 2 hours ago
(3 hours ago)Jorge_Stolfi Wrote: You are not allowed to view links. Register or Login to view.and the fact that they were compiled by the same Author and penned by the same Scribe.
If that were actually the case, the colour of the ink and the hand might change, but not the style of writing, as there is, after all, only one author.
Some things can be seen but not calculated.
Keep your eyes off the computer screen. -
RE: A mathematical approach to double words, conditional logic and the missing pages
Vuk88 > 51 minutes ago
(2 hours ago)Aga Tentakulus Wrote: You are not allowed to view links. Register or Login to view.
(3 hours ago)Jorge_Stolfi Wrote: You are not allowed to view links. Register or Login to view.and the fact that they were compiled by the same Author and penned by the same Scribe.
If that were actually the case, the colour of the ink and the hand might change, but not the style of writing, as there is, after all, only one author.
Some things can be seen but not calculated.
Keep your eyes off the computer screen.
@Aga Tentakulus,
The thing is the human eye is just an analytical tool, exactly like statistics or algorithms.
One doesn't necessarily exclude the other.
In fact, I could argue that the eye can be easily fooled too, especially since we aren't looking at the real manuscript, we are looking at a digital photograph.
The pixels making up that high-resolution image are just another form of standardization, exactly like the Takahashi transcription or any other text file. They are both simply tools that digitize and standardize the original information.
If we take the 'purist' route of keeping computers out of it, we'd have to toss out almost every visual analysis out there unless the researcher is physically sitting in the Beinecke Library, next to VMS.
Algorithms don't replace human intuition, they just help us quantify the visual patterns you're pointing out, to make sure they aren't just optical illusions or scribal noise.
At the end of the day, they're all just tools.