Module rustpython_parser::lexer

This module takes care of lexing python source text.

This means source code is translated into separate tokens.

Re-exports

pub use super::token::Tok;

Structs

Lexer
NewlineHandler

Functions

get_keywords
make_tokenizer

Type Definitions

LexResult
Spanned