31-07-2025, 02:23 PM
Really interesting work. I recommend looking under the hood at how LDA is defining "topics" with specific word types. In my own dalliances with LDA, I have found that LDA tends to create one "topic" that's defined by many of the globally commonest word types within the VMS and then assigns a lot of folios to this one topic. Something like that could be why according to LDA, the biological and cosmological sections are the same topic, while NMF says the two sections cleanly separate into different topics.

