Tokenise input. Class tokeniser is part of the experimental parser system, consisting of class parser, class tokeniser and class operator.
Do not use this class (yet).
