calcUnique: Pass only unique values to a computationally expensive...
In calcUnique: Simple Wrapper for Computationally Expensive Functions

Description Usage Arguments Details Value Examples

View source: R/calcUnique.R

In importing and working with tidy data, it is common to have index columns, often including time stamps that are far from unique. Some funcitons to work with these such as text conversion, various grep()-based functions, and often the /codecut() function are relatively slow when working with tens of millions of rows or more.

1	calcUnique(x, .f, ...)

`x`	A list or vector to be passed to `.f`
`.f`	The function to be called. It take as in input the incoming `x` vector or list and it must return a vector or list of the same length as the input.
`...`	Any other arguments to be passed to `.f`.

This wrapper function pares down the items to process to only unique values using hte unique() function. For a function that takes in a vector or list and returns a vector or list the same length, the inputs and outputs are the same as they would be otherwise ... it just happens faster.

The normal output of .f as long as it is of the same length os x

#Create a sample of some date text with repeats
ts_sample <-
  sample(
    as.character(
      seq(from = as.POSIXct('2020-03-01'), to = as.POSIXct('2020-03-15'), by = 'day')
      ),
    size = 30, replace = TRUE
  )

#Now convert the time text back to POSIXct timestamps:
as.POSIXct(ts_sample)

#Do the same with the calcUnique function:
calcUnique(ts_sample, as.POSIXct)

#Just to show that the output is the same with and without calcUnique:
all.equal(as.POSIXct(ts_sample),calcUnique(ts_sample, as.POSIXct))

#An example for when the function doesn't take the vector as the first argument:
gsub("00","$$", ts_sample)
calcUnique(ts_sample, function(i) gsub("00","$$", i))