An Artificial Construction
#25
(13-05-2026, 07:57 PM)oshfdk wrote: You are not allowed to view links. Register or Login to view.This can show that the way prefixes and suffixes in the Voynich Manuscript behave does not occur in natural languages. I think this may be true for any normal representation of any natural language in the history of humankind.

Have you tested the East Asian monosyllabic languages - Chinese,Vietnamese, Tibetan, Thai, Burmese, Lao, Khmer, ...

You are not allowed to view links. Register or Login to view. is a file of Mandarin (the Beijing Chinese language) in pinyin encoding. (It is in the Unicode UTF-8 encoding. You will have to download it; out web server displays it assuming the wrong encoding so it shows all garbled on your browser, and cut-paste will fail.)

Here is a python3 fragment that will read the file and convert tone diacritics to numeric tone suffixes (e.g. "shén" to "shen2") and "ü" to "uu" (e.g. "nǚ" to "nuu3"):

Code:
#! /usr/bin/python3 import os, sys, re; from sys import stdin as inp, stdout as out, stderr as err def main():   inp.reconfigure(encoding="utf-8")   out.reconfigure(encoding="utf-8")     out.write("# Created by {convert_pinyn_to_numeric.py} - do not edit.\n")   out.write("# -*- coding: utf-8 -*-\n")     pinyin_vows = r"āēīōūǖ" + r"àèìòùǜ" + r"áéíóúǘ" + r"ǎěǐǒǔǚ"   unmark_vows = r"aeiouü" * 4   ntones_nums = r"111111" + r"444444" + r"222222" + r"333333"   pats = []   subs = []   nv = len(pinyin_vows)   for i in range (nv):     pats.append(re.compile(pinyin_vows[i]))     subs.append(unmark_vows[i] + ntones_nums[i])   for line in inp:     line = line.strip()     if re.match(r"[ ]*([#]|$)", line):       continue     else:       m = re.fullmatch(r"([<][a-z][0-9.]+[>])[ ]*(.*)", line)       if m != None:         loc = m.group(1)         line = m.group(2)       else:         loc = ""       line = re.sub(r"[\]\[.,;:()]", " ", line)       words = line.split()       out.write(loc);       for word in words:         word = word.lower()         for i in range (nv):           word = re.sub(pats[i], subs[i], word)         word = re.sub(r"ü", "uu", word)         word = re.sub(r"^(.*)([0-9])(.*)$", r"\1\3\2", word)         if re.fullmatch(r"[a-z]+", word): word += "5"         out.write(" "); out.write(word)       out.write("\n")   return   # ----------------------------------------------------------------------     main()

All the best, --stolfi
Reply


Messages In This Thread
An Artificial Construction - by dashstofsk - 25-06-2025, 10:33 AM
RE: An Artificial Construction - by oshfdk - 25-06-2025, 11:21 AM
RE: An Artificial Construction - by RobGea - 25-06-2025, 12:21 PM
RE: An Artificial Construction - by dashstofsk - 25-06-2025, 12:37 PM
RE: An Artificial Construction - by oshfdk - 25-06-2025, 03:04 PM
RE: An Artificial Construction - by dashstofsk - 25-06-2025, 12:58 PM
RE: An Artificial Construction - by RobGea - 25-06-2025, 02:15 PM
RE: An Artificial Construction - by RobGea - 25-06-2025, 02:53 PM
RE: An Artificial Construction - by dashstofsk - 25-06-2025, 03:19 PM
RE: An Artificial Construction - by dashstofsk - 25-06-2025, 03:39 PM
RE: An Artificial Construction - by dashstofsk - 25-06-2025, 04:46 PM
RE: An Artificial Construction - by davidma - 25-06-2025, 05:32 PM
RE: An Artificial Construction - by dashstofsk - 25-06-2025, 08:25 PM
RE: An Artificial Construction - by Jorge_Stolfi - 17-11-2025, 12:39 AM
RE: An Artificial Construction - by ReneZ - 17-11-2025, 09:24 AM
RE: An Artificial Construction - by JoJo_Jost - 13-05-2026, 06:52 AM
RE: An Artificial Construction - by oshfdk - 13-05-2026, 09:54 AM
RE: An Artificial Construction - by dashstofsk - 13-05-2026, 07:56 AM
RE: An Artificial Construction - by JoJo_Jost - 13-05-2026, 08:09 AM
RE: An Artificial Construction - by oshfdk - 13-05-2026, 04:29 PM
RE: An Artificial Construction - by oshfdk - 13-05-2026, 07:57 PM
RE: An Artificial Construction - by Jorge_Stolfi - 13-05-2026, 10:29 PM
RE: An Artificial Construction - by oshfdk - 13-05-2026, 10:59 PM
RE: An Artificial Construction - by Jorge_Stolfi - 13-05-2026, 11:33 PM
RE: An Artificial Construction - by oshfdk - 14-05-2026, 10:06 AM
RE: An Artificial Construction - by nablator - 14-05-2026, 10:59 AM
RE: An Artificial Construction - by oshfdk - 14-05-2026, 11:10 AM
RE: An Artificial Construction - by Jorge_Stolfi - 14-05-2026, 02:17 PM
RE: An Artificial Construction - by oshfdk - 14-05-2026, 03:03 PM
RE: An Artificial Construction - by Jorge_Stolfi - 14-05-2026, 10:24 PM
RE: An Artificial Construction - by oshfdk - 15-05-2026, 12:14 AM
RE: An Artificial Construction - by nintus - 13-05-2026, 07:41 PM
RE: An Artificial Construction - by dashstofsk - 14-05-2026, 03:19 PM
RE: An Artificial Construction - by oshfdk - 14-05-2026, 04:37 PM
RE: An Artificial Construction - by rikforto - 14-05-2026, 08:36 PM
RE: An Artificial Construction - by oshfdk - 14-05-2026, 10:16 PM
RE: An Artificial Construction - by ReneZ - 14-05-2026, 11:42 PM
RE: An Artificial Construction - by oshfdk - 15-05-2026, 12:04 AM
RE: An Artificial Construction - by Jorge_Stolfi - 15-05-2026, 11:33 AM
RE: An Artificial Construction - by Jorge_Stolfi - 15-05-2026, 12:24 AM
RE: An Artificial Construction - by ReneZ - 15-05-2026, 12:27 AM
RE: An Artificial Construction - by oshfdk - 15-05-2026, 08:58 AM
RE: An Artificial Construction - by rikforto - 15-05-2026, 01:41 PM
RE: An Artificial Construction - by oshfdk - 15-05-2026, 11:40 PM
RE: An Artificial Construction - by JoJo_Jost - 16-05-2026, 05:21 AM
RE: An Artificial Construction - by oshfdk - 16-05-2026, 05:22 PM
RE: An Artificial Construction - by Jorge_Stolfi - 16-05-2026, 10:12 PM
RE: An Artificial Construction - by oshfdk - 16-05-2026, 10:46 PM
RE: An Artificial Construction - by ReneZ - 16-05-2026, 05:39 AM
RE: An Artificial Construction - by JoJo_Jost - 16-05-2026, 07:21 AM
RE: An Artificial Construction - by ReneZ - 16-05-2026, 05:45 AM
RE: An Artificial Construction - by ReneZ - 16-05-2026, 08:15 AM
RE: An Artificial Construction - by JoJo_Jost - 16-05-2026, 09:07 AM
RE: An Artificial Construction - by oshfdk - 16-05-2026, 05:32 PM
RE: An Artificial Construction - by RadioFM - 16-05-2026, 06:48 PM
RE: An Artificial Construction - by nablator - 16-05-2026, 07:19 PM
RE: An Artificial Construction - by oshfdk - 16-05-2026, 08:50 PM
RE: An Artificial Construction - by oshfdk - 16-05-2026, 05:56 PM
RE: An Artificial Construction - by nablator - 16-05-2026, 06:32 PM
RE: An Artificial Construction - by nablator - 16-05-2026, 06:59 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)