You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
CJK line breaking should not result in leading commas. #105
Line-break opportunities now come from the Unicode 17 UAX #14 segmenter instead of the previous ad hoc CJK rule. Regression coverage explicitly verifies that no soft break is allowed before CJK closing/nonstarter punctuation—including ，、。！？）】」』》〉々—and an end-to-end rich-text wrapping test verifies that wrapped lines never begin with those characters. Opening punctuation is similarly prevented from ending a line.
Verified with go test ./wordbreaking ./rich_text ./ltml.
Activity
rowland commentedon Aug 14, 2026
Resolved by #106 (cc271e2, merged as da80a3a).
Line-break opportunities now come from the Unicode 17 UAX #14 segmenter instead of the previous ad hoc CJK rule. Regression coverage explicitly verifies that no soft break is allowed before CJK closing/nonstarter punctuation—including
，、。！？）】」』》〉々—and an end-to-end rich-text wrapping test verifies that wrapped lines never begin with those characters. Opening punctuation is similarly prevented from ending a line.Verified with
go test ./wordbreaking ./rich_text ./ltml.