sql_tokenize: Tokenize SQL
In polyglotSQL: SQL Parsing, Analysis and Dialect Translation
sql_tokenize R Documentation
Tokenize SQL
Description
Splits SQL into lexical tokens using the tokenizer of the given dialect.
Usage
sql_tokenize(sql, dialect = "generic")
Arguments
sql
A single character string with one or more SQL statements
(separated by ;).
dialect
Dialect used for parsing.
Value
A data frame with class polyglot_tokens and one row per token:
type (token type, e.g. "Select", "Identifier", "Number"),
text (raw token text), line and column (1-based position),
start and end (byte offsets, end exclusive).
Examples
sql_tokenize("SELECT a FROM t")
polyglotSQL documentation built on Sept. 27, 2026, 5:06 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| sql_tokenize | R Documentation |
Tokenize SQL
Description
Splits SQL into lexical tokens using the tokenizer of the given dialect.
Usage
sql_tokenize(sql, dialect = "generic")
Arguments
sql |
A single character string with one or more SQL statements
(separated by |
dialect |
Dialect used for parsing. |
Value
A data frame with class polyglot_tokens and one row per token:
type (token type, e.g. "Select", "Identifier", "Number"),
text (raw token text), line and column (1-based position),
start and end (byte offsets, end exclusive).
Examples
sql_tokenize("SELECT a FROM t")
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.