21-05-2024, 06:25 AM
I do most of my analyses with tools I've written in the Awk language. I've attached the following files to make my frequency analysis tool available to Unix-savvy folks (especially those new to looking at the text):
* ekg2Awk.txt: this is the Awk code file -- I'm releasing it under the GPL v3.0 (or later) license. This is a "Swiss Army knife" tool that handles computing many of the common properties people look at when analyzing the text (Sukhotin's vowel detection algorithm, word type and token length distributions, fitting Zip's Law to word frequencies, (unconditional) entropies, type/token ratio).
* COPYING.txt -- the GPL v3.0 license text
* HerbA.txt and BioB.txt -- the Herbal A and Biological B portions of the D'Imperio transcription using Currier's transcription alphabet. These are provided because they're easy to preprocess in order to simplify exploring use of the tool. You can use the transcription of your choice as long as you figure out how to strip off line identification prefixes, handle alternate possible glyph readings, and convert non-ASCII transcription characters into something ASCII (probably the transcription alphabet's "weirdo" character). I have sed scripts that handle that for the EVA-based transcriptions and the v101 transcription, but I didn't want to have to get into documenting and releasing those scripts as part of releasing the basic tool. You can also feed appropriately preprocessed natural language text samples into the program for comparison of their properties to those of the Voynich mss text.
* OutputExamples.txt -- some additional examples of using the program beyond those in the documentation comments at the start of the program file. I included this file because I suspect that the program output would get mangled (line wrapped, etc.) when put in the body of a post. (Also, it doesn't look like any of the available fonts for posts are fixed-width
). Look at this file using a fixed-width font (for example, Consolas Regular in Notepad under Windows).
It is important to run this is a terminal window that's using a fixed-width font.
I hope folks will find this of value.
Karl
* ekg2Awk.txt: this is the Awk code file -- I'm releasing it under the GPL v3.0 (or later) license. This is a "Swiss Army knife" tool that handles computing many of the common properties people look at when analyzing the text (Sukhotin's vowel detection algorithm, word type and token length distributions, fitting Zip's Law to word frequencies, (unconditional) entropies, type/token ratio).
* COPYING.txt -- the GPL v3.0 license text
* HerbA.txt and BioB.txt -- the Herbal A and Biological B portions of the D'Imperio transcription using Currier's transcription alphabet. These are provided because they're easy to preprocess in order to simplify exploring use of the tool. You can use the transcription of your choice as long as you figure out how to strip off line identification prefixes, handle alternate possible glyph readings, and convert non-ASCII transcription characters into something ASCII (probably the transcription alphabet's "weirdo" character). I have sed scripts that handle that for the EVA-based transcriptions and the v101 transcription, but I didn't want to have to get into documenting and releasing those scripts as part of releasing the basic tool. You can also feed appropriately preprocessed natural language text samples into the program for comparison of their properties to those of the Voynich mss text.
* OutputExamples.txt -- some additional examples of using the program beyond those in the documentation comments at the start of the program file. I included this file because I suspect that the program output would get mangled (line wrapped, etc.) when put in the body of a post. (Also, it doesn't look like any of the available fonts for posts are fixed-width
). Look at this file using a fixed-width font (for example, Consolas Regular in Notepad under Windows).It is important to run this is a terminal window that's using a fixed-width font.
I hope folks will find this of value.
Karl