token_utils.token_class

Functions

make_fake_token([type, string, start, end, line])

Useful when we need to process a list of tokens with multiple consecutive at a time, and we need to lengthen the list for doing so.

Classes

Token(token)

Token as generated from Python's tokenize.generate_tokens written here in a more convenient form, and with some custom methods.