The full segmentation of one input string.
comment spans (analyzed-byte offsets), dropped from the statement stream.
Unbalanced delimiters and other structural surprises, each located; never a throw. Includes the two coordinate-pass classes (bom, non-ascii).
bom
non-ascii
The full segmentation of one input string.