get_first_token_type_of_line: Get type of first token on the line

In langfob/docaids: Package For Helping Document Local Variables In R

Description

Tokenizes the whole line and then returns the type associated with the first token on the line. This is useful because the first token is what flags whether the line is the start of a chunk, variable, or function or whether it's a continuation line of a function or a variable.

Usage

get_first_token_type_of_line(data_line)

Arguments

data_line

character string containing one full line from the input file

Details

This doesn't really need to tokenize the whole line since it only uses the first token. Not sure if there's a way to ask for just one token.

Value

character string containing the first token type of the line, e.g., "whitespace" or "symbol"

langfob/docaids documentation built on May 20, 2019, 7:56 p.m.