get_tokens

lexnlp.nlp.en.tokens.get_tokens(text, lowercase=False, stopword=False) → typing.Generator

Get token generator from text. :param text: :param lowercase: :param stopword: :return: