Function resolveSentinelTokens

Resolve declared sentinel texts against a tokenizer. A declared marker that is not one token there means the declaration does not fit this tokenizer.