GPT Models Fail to Find Language Structure in the Voynich Manuscript
#25
(03-07-2025, 02:34 PM)Jorge_Stolfi wrote: You are not allowed to view links. Register or Login to view.Google Drive says I don't have permission to read that link.

From the Voynichese output that you quoted, it seems that many word spaces are missing.  I suppose they were marked with comma ("possible space") instead of period in the original file. (Or, sadly,not marked at all: it looks like the Scribe sometimes ran words together by accident.)  Would you consider trying again with periods and commas treated as word separators?

OK, now you should have access. Let me explain the content of the files: the output is a GPT generated text with words separated by a dot. In the html, each bigram is analyzed separately. For example, for the first line of the quoted image: 

- the GPT output was: sharo.ydy.cheal.omororom.chol.pcheo.olkaim
- in the htm file, you will see bigram by bigram (or trigram by trigram), this is sharo.ydy ydy.cheal cheal.omororom omororom.chol chol.pcheo pcheo.olkaim
- these bigrams are compared against the original corpus and highlighted in green if they appear in the exact same order, or in red if they do not (i.e., the two words never occur together in that order in the original text).
- the GPT does not create new words, all words are valid ones. The creation of new words is studied in another thread, where I trained GPT character by character.

I hope it makes sense to you.

Regards
[+] 1 user says Thank You to quimqu for this post
Reply


Messages In This Thread
RE: GPT Models Fail to Find Language Structure in the Voynich Manuscript - by quimqu - 03-07-2025, 02:43 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Measuring Long-Range Structure in the Voynich Manuscript quimqu 49 15,815 28-02-2026, 09:56 AM
Last Post: quimqu
  How LLM models try to understand Voynichese quimqu 6 6,422 28-09-2025, 09:18 AM
Last Post: stopsquark
  Why the Voynich Manuscript Might Not Be a Real Language quimqu 26 18,210 26-06-2025, 05:11 AM
Last Post: ReneZ
  Narration structure as the tiebreaker between cipher & (synthetic) language Anton 12 21,961 03-02-2016, 03:40 PM
Last Post: MarcoP

Forum Jump:


Users browsing this thread: 1 Guest(s)