Lex the arguments of ONE statement, starting at from.
text is the statement, from is where its leading run ended
(VerbSplitCommandReading.argsAt). Offsets in the result are relative to
text, so a caller rebases them by the statement's own span; it never throws.
Only ASCII text may be passed. The analyzed surface is ASCII by construction
(coordinates.ts stands one byte in for every non-ASCII one), and a caller
that hands over the ORIGINAL text of a non-ASCII statement would get spans
that do not map back — src/explain.ts verifies the two agree before calling.
Lex the arguments of ONE statement, starting at
from.textis the statement,fromis where its leading run ended (VerbSplitCommandReading.argsAt). Offsets in the result are relative totext, so a caller rebases them by the statement's own span; it never throws.Only ASCII text may be passed. The analyzed surface is ASCII by construction (
coordinates.tsstands one byte in for every non-ASCII one), and a caller that hands over the ORIGINAL text of a non-ASCII statement would get spans that do not map back —src/explain.tsverifies the two agree before calling.