Ruby 3.3.7p123 (2025-01-15 revision be31f993d7fa0219d85f7b3c694d454da4ecc10b)
|
When you are lexing through a file, the lexer needs all of the information that the parser additionally provides (for example, the local table). More...
#include <parser.h>
Data Fields | |
void * | data |
This opaque pointer is used to provide whatever information the user deemed necessary to the callback. | |
void(* | callback )(void *data, pm_parser_t *parser, pm_token_t *token) |
This is the callback that is called when a token is lexed. | |
When you are lexing through a file, the lexer needs all of the information that the parser additionally provides (for example, the local table).
So if you want to properly lex Ruby, you need to actually lex it in the context of the parser. In order to provide this functionality, we optionally allow a struct to be attached to the parser that calls back out to a user-provided callback when each token is lexed.
void(* pm_lex_callback_t::callback) (void *data, pm_parser_t *parser, pm_token_t *token) |
void* pm_lex_callback_t::data |