About the construction of lines in the MS

[quimqu]

I suppose you are using a neural network to measure the anomalies, so you cannot tell what exactly it is measuring?

I’m not using a neural net. It’s a simple score.

Roughly, I learn what typical line endings look like and what typical line beginnings look like, at the character level. Then for any cut I score how “end-like” the left side is and how “start-like” the right side is, compared to the overall background. Real breaks tend to have high scores on both sides.

AUC (Area Under the Curve) here just means: probability that a real break scores higher than a fake one. 0.5 is no signal, 1.0 is perfect.

On the m → iin change:

AUC barely moves:

• heldout ~0.969 → ~0.968
  
• other ~0.966 → ~0.967
  

So essentially unchanged.

But in the harder comparisons (real vs controls), it clearly drops:

• heldout ~0.88 → ~0.65
  
• other ~1.10 → ~0.45
  

End-of-line scores also go down everywhere, sometimes a lot (e.g. ~1.17 → ~0.70 in Cosmological).

And in your test, SLA does not beat TLA. On average it’s slightly worse (around −0.17 in heldout at W≈0.62, smaller differences elsewhere).

So expanding m to iin does not make the structure more visible in this setup. If anything it weakens it, including at real line ends.

What kind of effect did you expect. Slight improvement, or clearly SLA > TLA?