Mapping between Currier A and B
#19
I have run a first set of experiments, according to the simple approach described in the first post. In particular:
  • I matched A (HerbalA+Pharma) vs B (HerbalB+Stars+Bio), ignoring the intermediate sections Astro / Cosmo / Zodiac (as suggested by Nick You are not allowed to view links. Register or Login to view.);
  • I used three different transliteration systems: EVA, Cuva, Currier. The basis for all being the Zandbergen-Landini Eva file, ignoring uncertain spaces;
  • I searched for rewrite rules making A closer to B;
  • as a difference measure, I considered the difference between word histograms (absolute value of the % frequency difference between each word type); this measure falls in the 0-1 range; the distance between the two unmodified sets is about 0.68, for all transliterations;
  • each set A,B was treated as a single string, with '.' representing a space between words and '|' a line-break;
  • for each set A,B the 100 most frequent character sequences of length 1-4 were considered; for each combination, the variation in distance was measured and the highest negative differences were selected.
Given this procedure, obviously the transliteration system only has a minor effect (e.g. Cuva/Currier sequences of length 4 often correspond to longer Eva sequences - Currier:SC89 corresponds to EVA:chedy which is too long to enter the scope of this experiment).

These are the top 20 results for the three systems.

You are not allowed to view links. Register or Login to view.

There clearly is a lot of redundancy and most results convert various A suffixes into B:-edy. The reason for this is quite obvious.

It is possibly less obvious that
or -> edy.
appears to be more effective than
or. -> edy.
The difference between the two is that the first one can break an A word e.g. 
dorchaiin -> dedy.chaiin
where (in this case) both resulting words appear in B. The second rule only applies to the subset of the scope where -or is word final.

Another substitution I did not expect is:
y.d -> dy.
this results in rewrites like:
shey.dair -> shedy.air
chy.dam -> chdy.am
which indeed transform A-word-sequences into valid B-words.

There could be other substitutions worth commenting upon, but my main interest now is understanding how to proceed. A possibility could be re-formulating this search into something like "simulated annealing", rather than this simple brute-force approach. Also, a distance measure that considers the overlap between word-sequences (instead of word frequencies alone) is something I am curious about.
[+] 6 users say Thank You to MarcoP for this post
Reply


Messages In This Thread
Mapping between Currier A and B - by MarcoP - 09-12-2019, 02:26 PM
RE: Mapping between Currier A and B - by ReneZ - 09-12-2019, 03:12 PM
RE: Mapping between Currier A and B - by nablator - 09-12-2019, 05:58 PM
RE: Mapping between Currier A and B - by MarcoP - 09-12-2019, 08:39 PM
RE: Mapping between Currier A and B - by nablator - 09-12-2019, 10:18 PM
RE: Mapping between Currier A and B - by nablator - 11-12-2019, 06:20 PM
RE: Mapping between Currier A and B - by -JKP- - 09-12-2019, 05:41 PM
RE: Mapping between Currier A and B - by ReneZ - 09-12-2019, 06:52 PM
RE: Mapping between Currier A and B - by -JKP- - 09-12-2019, 08:45 PM
RE: Mapping between Currier A and B - by Koen G - 09-12-2019, 09:42 PM
RE: Mapping between Currier A and B - by -JKP- - 09-12-2019, 10:01 PM
RE: Mapping between Currier A and B - by Koen G - 09-12-2019, 11:28 PM
RE: Mapping between Currier A and B - by Torsten - 10-12-2019, 02:18 AM
RE: Mapping between Currier A and B - by MarcoP - 10-12-2019, 03:32 PM
RE: Mapping between Currier A and B - by Torsten - 11-12-2019, 12:39 AM
RE: Mapping between Currier A and B - by ReneZ - 10-12-2019, 04:18 PM
RE: Mapping between Currier A and B - by -JKP- - 10-12-2019, 05:34 PM
RE: Mapping between Currier A and B - by ReneZ - 10-12-2019, 06:33 PM
RE: Mapping between Currier A and B - by MarcoP - 13-12-2019, 11:38 AM
RE: Mapping between Currier A and B - by nablator - 13-12-2019, 12:59 PM
RE: Mapping between Currier A and B - by ReneZ - 14-12-2019, 09:35 AM
RE: Mapping between Currier A and B - by MarcoP - 15-12-2019, 11:47 AM
RE: Mapping between Currier A and B - by ReneZ - 15-12-2019, 01:23 PM
RE: Mapping between Currier A and B - by MarcoP - 15-12-2019, 05:08 PM
RE: Mapping between Currier A and B - by MarcoP - 19-12-2019, 03:21 PM
RE: Mapping between Currier A and B - by ReneZ - 20-12-2019, 12:49 AM
RE: Mapping between Currier A and B - by MarcoP - 21-03-2020, 02:50 PM
RE: Mapping between Currier A and B - by MarcoP - 21-03-2020, 06:43 PM
RE: Mapping between Currier A and B - by MarcoP - 24-03-2020, 10:59 AM
RE: Mapping between Currier A and B - by MarcoP - 25-08-2020, 11:29 AM
RE: Mapping between Currier A and B - by MarcoP - 04-09-2020, 03:30 PM
RE: Mapping between Currier A and B - by nablator - 04-09-2020, 04:03 PM

Forum Jump:


Users browsing this thread: