TokenDefinition Struct Reference

A single token definition in the table. More...

#include <token_table.h>

Data Fields
ExtensionID	extension_id
	Which extension added it (0 = base)
const char *	lexeme
	Token string (e.g., "SELECT")
size_t	lexeme_len
	Length of lexeme.
uint32_t	next_in_chain
	Hash collision chain link.
int	token_code
	Token ID (e.g., TK_SELECT)

Detailed Description

A single token definition in the table.

Definition at line 25 of file token_table.h.

Field Documentation

extension_id

ExtensionID TokenDefinition::extension_id

Which extension added it (0 = base)

Definition at line 29 of file token_table.h.

lexeme

const char* TokenDefinition::lexeme

Token string (e.g., "SELECT")

Definition at line 26 of file token_table.h.

lexeme_len

size_t TokenDefinition::lexeme_len

Length of lexeme.

Definition at line 27 of file token_table.h.

next_in_chain

uint32_t TokenDefinition::next_in_chain

Hash collision chain link.

Definition at line 30 of file token_table.h.

token_code

int TokenDefinition::token_code

Token ID (e.g., TK_SELECT)

Definition at line 28 of file token_table.h.

---

The documentation for this struct was generated from the following file:

• include/token_table.h