29-04-2025, 02:53 PM
(29-04-2025, 02:32 PM)davidd wrote: You are not allowed to view links. Register or Login to view.Hi Urtx13,
I only skimmed this thread but maybe you can address this question i have based on the code in the github:
Is this summary correct:
You seem to train a TF classifier model on the complete voynich, all folios, with some value added to each folio during training.
Then you test the model and all the folios come back correctly identified by the classifier model.
This is not how you normally test classifiers. Normally when you have limited example data, you remove part of the data from the training, and validate that your classifier trained on the other data is classifying the removed parts correctly. When you present a classifier with data it was trained on, it will give you the classification it was trained to produce. Maybe this process is hidden in one of the libraries you call, but i dont see it happen inside your code itself.
Can you elaborate on this?
Yes, you are completely correct. That is why I am doing some changes to the code. Since the aim may differ a little bit I oponed another topic. Check it please!

