tokenize_ast: Tokenizer for python ast

Description Usage Arguments Value

View source: R/tokenize_ast.R

Description

Tokenizer for python ast

Usage

1
tokenize_ast(script_path, path_prefix = ".")

Arguments

script_path

absolute paths from scripts to tokenize.

path_prefix

leading folders from absolute path to omit from names.

Value

a named list, compatible with quanteda::tokenize()


benjaminschwetz/Rchitecture documentation built on Dec. 19, 2021, 8:42 a.m.