• Options
• Login
• Desktop Style

update to Zattera's slot machine

• Index

  • The Voynich Ninja
  • Voynich Research
  • News
  • [Article] update to Zattera's slot machine
• update to Zattera's slot machine

• update to Zattera's slot machine

  Labyrinthinesecurity > 1 hour ago

  Using switchable templates, it looks like we can improve Zattera's slot machine performance:
  
  
  Metric      Before  After    Change
  Generated  3,110    5,524    +2,414
  TP types    1,226    1,680    +454
  TP tokens  20,454  24,662  +4,208
  Precision  0.3942  0.3041  -0.0901
  Recall      0.1468  0.2011  +0.0543
  F1          0.2139  0.2421  +0.0282
  TokCov      0.5491  0.6620  +0.1129
  
  Note that we worked on the IVTFF corpus, not Zattera's homebrew Slot Alphabet. 
  
  The improved grammar (F1=0.242) outperforms Zattera's grammar (F1=0.214) when both are scored on our corpus. However, Zattera reports F1=0.270 on his own filtered corpus (~5,105 types), and our grammar was F1-trained on the test corpus while his was not.

• RE: update to Zattera's slot machine

  oshfdk > 53 minutes ago

  (1 hour ago)Labyrinthinesecurity Wrote: You are not allowed to view links. Register or Login to view.The improved grammar (F1=0.242) outperforms Zattera's grammar (F1=0.214) when both are scored on our corpus. However, Zattera reports F1=0.270 on his own filtered corpus (~5,105 types), and our grammar was F1-trained on the test corpus while his was not.

  
  What are the You are not allowed to view links. Register or Login to view.? I don't think F1 is informative when comparing two different grammar mechanics. Whatever "switchable templates" are they sound like they can capture some information too, leading to visibly better numbers for no actual improvement in the grammar.

• RE: update to Zattera's slot machine

  Labyrinthinesecurity > 32 minutes ago

  (53 minutes ago)oshfdk Wrote: You are not allowed to view links. Register or Login to view.

  (1 hour ago)Labyrinthinesecurity Wrote: You are not allowed to view links. Register or Login to view.The improved grammar (F1=0.242) outperforms Zattera's grammar (F1=0.214) when both are scored on our corpus. However, Zattera reports F1=0.270 on his own filtered corpus (~5,105 types), and our grammar was F1-trained on the test corpus while his was not.

  
  What are the You are not allowed to view links. Register or Login to view.? I don't think F1 is informative when comparing two different grammar mechanics. Whatever "switchable templates" are they sound like they can capture some information too, leading to a visibly better numbers for no actual improvement in the grammar.

  
  I wasnt aware of Landinî s metric, as a big fan of.Kolmogorov complexity I can only approve of Nbits, its sounds like a perfect addition to coverage! Thanks for sharing this gem
• Next Oldest Next Newest