17-04-2026, 11:12 PM
I checked again line-internal continuity more strictly.
If I split lines in the middle, the real continuation looks very strong at first. It often ranks near the top, with about 30% top-1 and over 50% top-5. So there is clearly structure inside the line.
But once I control for global frequency, most of that signal disappears. Comparing only against equally frequent alternatives, the real continuation is no longer special. Top-1 drops to ~2% and top-5 to ~5%, and the excess score is near or below zero. The same happens even if I switch to rough morphological patterns instead of exact chunks.
So there is local regularity, but it looks mostly formulaic. The line interior is structured, but not strongly driven by immediate context.
If I split lines in the middle, the real continuation looks very strong at first. It often ranks near the top, with about 30% top-1 and over 50% top-5. So there is clearly structure inside the line.
But once I control for global frequency, most of that signal disappears. Comparing only against equally frequent alternatives, the real continuation is no longer special. Top-1 drops to ~2% and top-5 to ~5%, and the excess score is near or below zero. The same happens even if I switch to rough morphological patterns instead of exact chunks.
So there is local regularity, but it looks mostly formulaic. The line interior is structured, but not strongly driven by immediate context.