create_data: Create a Unified Observation Dataset in the BD_Obs Format...

In InterpolateR: A Comprehensive Toolkit for Fast and Efficient Spatial Interpolation

Create a Unified Observation Dataset in the BD_Obs Format from Multiple CSV Files This function constructs a unified dataset (BD_Obs structure) by merging multiple CSV files, each containing in-situ observations from different stations. The function standardizes the format required by downstream interpolation or bias correction algorithms by aligning all station data into a single data.table, with dates as rows and station identifiers as columns.

Description

Each input CSV file must contain exactly two columns: the first with dates (Date) and the second with the in-situ measurements of the variable to be interpolated.

Usage

create_data(file.path, Start_date, End_Date, ncores = NULL, max.na = NULL)

Arguments

file.path	character. Path to the folder containing the CSV files. Each file should represent a single station and be named using the station ID (e.g., M001.csv). Each file must have exactly two columns: a date column and a column of in-situ observations for the variable to be interpolated.
Start_date	Date. Start date of the period to be included in the merged dataset. If the CSV files cover different date ranges, this defines the initial bound of the common time window for merging.
End_Date	Date. End date of the period to be included in the merged dataset. This sets the upper bound of the time window to consider across all files.
ncores	integer. Number of processing cores to be used when reading and merging CSV files in parallel. If If you want to perform the procedure without parallelization, set ncores = NULL. The default is NULL.
max.na	numeric, optional. Maximum acceptable percentage of missing values per station (from 0 to 100). Stations exceeding this threshold will be excluded. If NULL, no filtering is performed. Default is NULL.

Value

If max.na is NULL, the function returns a data.table structured in the BD_Obs format, where the first column contains the dates and the remaining columns correspond to individual stations. This format preserves the full dataset without filtering for missing values.

If max.na is not NULL, the function returns a named list containing:

data

A data.table in the BD_Obs format that includes only stations with a percentage of missing values less than or equal to max.na.

Na_stations

A data.table summarizing the percentage of missing values for each station, useful for assessing data quality and supporting decisions about station selection.

Author(s)

Jonnathan Augusto landi Bermeo, [e-mail]

Examples

# Example usage
file.path <- system.file("extdata/Folds_ejs_create_data", package = "InterpolateR")

# Create a data with all stations
data <- create_data(file.path, Start_date = "2015-01-01", End_Date = "2015-03-01", ncores = NULL)

InterpolateR documentation built on Sept. 9, 2025, 5:59 p.m.