st_tokens.pl -- Template tokenizer

Recognizes tokens from symbol codes.

 st_tokens(+Codes, +Options, -Tokens) is det

Tokenizes the given input into tokens.

Throws error(invalid_input(String)) when the input in out/block instruction cannot be parsed into a Prolog term.