loupe: Loupe: compare new and old data in continuously updated...

In butterfly: Verification for Continually Updating Time Series Data

Loupe: compare new and old data in continuously updated timeseries

Description

A loupe is a simple, small magnification device used to examine small details more closely.

Usage

loupe(df_current, df_previous, datetime_variable, ...)

Arguments

df_current	data.frame, the newest/current version of dataset x.
df_previous	data.frame, the old version of dataset, for example x - t1.
datetime_variable	string, which variable to use as unique ID to join df_current and df_previous. Usually a "datetime" variable.
...	Other waldo::compare() arguments can be supplied here, such as tolerance or max_diffs. See ?waldo::compare() for a full list.

Details

This function is intended to aid in the verification of continually updating timeseries data where we expect new values but want to ensure previous values remains unchanged.

This function matches two dataframe objects by their unique identifier (usually "time" or "datetime in a timeseries).

It informs the user of new (unmatched) rows which have appeared, and then returns a waldo::compare() call to give a detailed breakdown of changes. If you are not familiar with waldo::compare(), this is an expanded and more verbose function similar to base R's all.equal().

loupe() will then return TRUE if there are not changes to previous data, or FALSE if there are unexpected changes. If you want to extract changes as a dataframe, use catch(), or if you want to drop them, use release().

The main assumption is that df_current and df_previous are a newer and older versions of the same data, and that the datetime_variable variable name always remains the same. Elsewhere new columns can of appear, and these will be returned in the report.

The underlying functionality is handled by create_object_list().

Value

A boolean where TRUE indicates no changes to previous data and FALSE indicates unexpected changes.

See Also

create_object_list()

Examples

# Checking two dataframes for changes
# Returning TRUE (no changes) or FALSE (changes)
# This example contains no differences with previous data
butterfly::loupe(
  butterflycount$february, # New or current dataset
  butterflycount$january, # Previous version you are comparing it to
  datetime_variable = "time" # Unique ID variable they have in common
)

# This example does contain differences with previous data
butterfly::loupe(
  butterflycount$march,
  butterflycount$february,
  datetime_variable = "time"
)

butterfly documentation built on April 12, 2025, 9:10 a.m.