R/deprecated-wb.R
In nset-ornl/wbstats: Programmatic Access to Data and Statistics from the World Bank API
Defines functions
wb
Documented in
wb
#' Download Data from the World Bank API
#'
#' This function downloads the requested information using the World Bank API
#'
#' @param country Character vector of country or region codes. Default value is special code of \code{all}.
#' Other permissible values are codes in the following fields from the \code{\link{wb_cachelist}} \code{country}
#' data frame. \code{iso3c}, \code{iso2c}, \code{regionID}, \code{adminID}, and \code{incomeID}.
#' Additional special values include \code{aggregates}, which returns only aggregates, and \code{countries_only},
#' which returns all countries without aggregates.
#' @param indicator Character vector of indicator codes. These codes correspond to the \code{indicatorID} column
#' from the \code{indicator} data frame of \code{\link{wbcache}} or \code{\link{wb_cachelist}}, or
#' the result of \code{\link{wbindicators}}
#' @param startdate Numeric or character. If numeric it must be in \%Y form (i.e. four digit year).
#' For data at the subannual granularity the API supports a format as follows: for monthly data, "2016M01"
#' and for quarterly data, "2016Q1". This also accepts a special value of "YTD", useful for more frequently
#' updated subannual indicators.
#' @param enddate Numeric or character. If numeric it must be in \%Y form (i.e. four digit year).
#' For data at the subannual granularity the API supports a format as follows: for monthly data, "2016M01"
#' and for quarterly data, "2016Q1".
#' @param mrv Numeric. The number of Most Recent Values to return. A replacement of \code{startdate} and \code{enddate},
#' this number represents the number of observations you which to return starting from the most recent date of collection.
#' Useful in conjuction with \code{freq}
#' @param return_wide Logical. If \code{TRUE} data is returned in a wide format instead of long, with a column named for each
#' \code{indicatorID}. To necessitate this transformation, the \code{indicator} column, that provides the human readable description
#' is dropped. This field is available through from the \code{indicator} data frame of \code{\link{wbcache}} or \code{\link{wb_cachelist}},
#' or the result of \code{\link{wbindicators}}. Default is \code{FALSE}
#' @param gapfill Logical. Works with \code{mrv}. If \code{TRUE} fills values, if not available, by back tracking to the
#' next available period (max number of periods back tracked will be limited by \code{mrv} number)
#' @param freq Character String. For fetching quarterly ("Q"), monthly("M") or yearly ("Y") values.
#' Currently works along with \code{mrv}. Useful for querying high frequency data.
#' @param cache List of data frames returned from \code{\link{wbcache}}. If omitted,
#' \code{\link{wb_cachelist}} is used
#' @param lang Language in which to return the results. If \code{lang} is unspecified,
#' english is the default.
#' @param removeNA if \code{TRUE}, remove any blank or \code{NA} observations that are returned.
#' if \code{FALSE}, no blank or \code{NA} values are removed from the return.
#' @param POSIXct if \code{TRUE}, additonal columns \code{date_ct} and \code{granularity} are added.
#' \code{date_ct} converts the default date into a \code{\link[base]{POSIXct}}. \code{granularity}
#' denotes the time resolution that the date represents. Useful for subannual data and mixing subannual
#' with annual data. If \code{FALSE}, these fields are not added.
#' @param include_dec if \code{TRUE}, the column \code{decimal} is not removed from the return. if \code{FALSE},
#' this column is removed
#' @param include_unit if \code{TRUE}, the column \code{unit} is not removed from the return. if \code{FALSE},
#' this column is removed
#' @param include_obsStatus if \code{TRUE}, the column \code{obsStatus} is not removed from the return. if \code{FALSE},
#' this column is removed
#' @param include_lastUpdated if \code{TRUE}, the column \code{lastUpdated} is not removed from the return. if \code{FALSE},
#' this column is removed. If \code{TRUE} and \code{POSIXct = TRUE} then column will be of class \code{\link[base]{Date}}
#' @return Data frame with all available requested data.
#'
#' @note Not all data returns have support for langauges other than english. If the specific return
#' does not support your requested language by default it will return \code{NA}. For an enumeration of
#' supported languages by data source please see \code{\link{wbdatacatalog}}.
#' The options for \code{lang} are:
#' \itemize{
#' \item \code{en}: English
#' \item \code{es}: Spanish
#' \item \code{fr}: French
#' \item \code{ar}: Arabic
#' \item \code{zh}: Mandarin
#' }
#' The \code{POSIXct} parameter requries the use of \code{\link[lubridate]{lubridate}} (>= 1.5.0). All dates
#' are rounded down to the floor. For example a value for the year 2016 would have a \code{POSIXct} date of
#' \code{2016-01-01}. If this package is not available and the \code{POSIXct} parameter is set to \code{TRUE},
#' the parameter is ignored and a \code{warning} is produced.
#'
#' The \code{include_dec}, \code{include_unit}, and \code{include_obsStatus} are defaulted to \code{FALSE}
#' because as of writing, all returns have a value of \code{0}, \code{NA}, and \code{NA}, respectively.
#' These columns might be used in the future by the API, therefore the option to include the column is available.
#'
#' The \code{include_lastUpdated} is defaulted to \code{FALSE} as well to limit the
#'
#' If there is no data available that matches the request parameters, an empty data frame is returned along with a
#' \code{warning}. This design is for easy aggregation of multiple calls.
#'
#' @examples
#' # GDP at market prices (current US$) for all available countries and regions
#' \donttest{wb(indicator = "NY.GDP.MKTP.CD", startdate = 2000, enddate = 2016)}
#'
#' # GDP and Population in long format for the most recent 20 observations
#' \donttest{wb(indicator = c("SP.POP.TOTL","NY.GDP.MKTP.CD"), mrv = 20)}
#'
#' # GDP and Population in wide format for the most recent 20 observations
#' \donttest{wb(indicator = c("SP.POP.TOTL","NY.GDP.MKTP.CD"), mrv = 20, return_wide = TRUE)}
#'
#' # query using regionID or incomeID
#' # High Income Countries and Sub-Saharan Africa (all income levels)
#' wb(country = c("HIC", "SSF"), indicator = "NY.GDP.MKTP.CD", startdate = 1985, enddate = 1985)
#'
#' # if you do not know when the latest time an indicator is avaiable mrv can help
#' wb(country = c("IN"), indicator = 'EG.ELC.ACCS.ZS', mrv = 1)
#'
#' # increase the mrv value to increase the number of maximum number of returns
#' wb(country = c("IN"), indicator = 'EG.ELC.ACCS.ZS', mrv = 35)
#'
#' # GDP at market prices (current US$) for only available countries
#' \donttest{wb(country = "countries_only", indicator = "NY.GDP.MKTP.CD", startdate = 2000, enddate = 2016)}
#'
#' # GDP at market prices (current US$) for only available aggregate regions
#' \donttest{wb(country = "aggregates", indicator = "NY.GDP.MKTP.CD", startdate = 2000, enddate = 2016)}
#'
#' # if you want to "fill-in" the values in between actual observations use gapfill = TRUE
#' # this highlights a very important difference.
#' # all other parameters are the same as above, except gapfill = TRUE
#' # and the results are very different
#' wb(country = c("IN"), indicator = 'EG.ELC.ACCS.ZS', mrv = 35, gapfill = TRUE)
#'
#' # if you want the most recent values within a certain time frame
#' wb(country = c("US"), indicator = 'SI.DST.04TH.20', startdate = 1970, enddate = 2000, mrv = 2)
#'
#' # without the freq parameter the deafult temporal granularity search is yearly
#' # should return the 12 most recent years of data
#' wb(country = c("CHN", "IND"), indicator = "DPANUSSPF", mrv = 12)
#'
#' # if another frequency is available for that indicator it can be accessed using the freq parameter
#' # should return the 12 most recent months of data
#' wb(country = c("CHN", "IND"), indicator = "DPANUSSPF", mrv = 12, freq = "M")
#' @export
wb <- function(country = "all", indicator, startdate, enddate, mrv, return_wide = FALSE, gapfill,
freq, cache, lang = c("en", "es", "fr", "ar", "zh"), removeNA = TRUE, POSIXct = FALSE,
include_dec = FALSE, include_unit = FALSE, include_obsStatus = FALSE, include_lastUpdated = FALSE) {
lifecycle::deprecate_soft("1.0.0", "wbstats::wb()", "wbstats::wb_data()")
lang <- match.arg(lang)
url_list <- wburls()
base_url <- url_list$base_url
utils_url <- url_list$utils_url
if (missing(cache)) cache <- wbstats::wb_cachelist_dep
# check country ----------
if ("all" %in% country) {
country_url <- "all"
} else if ("aggregates" %in% country) {
cache_cn <- cache$countries[cache$countries$region == "Aggregates" , "iso3c" ]
country_url <- paste0(cache_cn, collapse = ";")
} else if ("countries_only" %in% country) {
cache_cn <- cache$countries[cache$countries$region != "Aggregates" , "iso3c" ]
country_url <- paste0(cache_cn, collapse = ";")
} else {
cache_cn <- cache$countries
cn_check <- cache_cn[ , c("iso3c", "iso2c", "regionID", "adminID", "incomeID")]
cn_check <- unique(unlist(cn_check, use.names = FALSE))
cn_check <- cn_check[!is.na(cn_check)]
good_cn_index <- country %in% cn_check
good_cn <- country[good_cn_index]
if (length(good_cn) == 0) stop("country parameter has no valid values. Please check documentation for valid inputs")
bad_cn <- country[!good_cn_index]
if (length(bad_cn) > 0) warning(paste0("The following country values are not valid and are being excluded from the request: ",
paste(bad_cn, collapse = ",")))
country_url <- paste0(good_cn, collapse = ";")
}
# check indicator ----------
cache_ind <- cache$indicators
ind_check <- cache_ind[, "indicatorID"]
ind_check <- ind_check[!is.na(ind_check)] # should never be needed but make sure
good_ind_index <- indicator %in% ind_check
good_ind <- indicator[good_ind_index]
if (length(good_ind) == 0) stop("indicator parameter has no valid values. Please check documentation for valid inputs")
bad_ind <- indicator[!good_ind_index]
if (length(bad_ind) > 0) warning(paste0("The following indicator values are not valid and are being excluded from the request: ",
paste(bad_ind, collapse = ",")))
## check date and other parameters. add to list if not missing ----------
param_url_list <- list()
# check dates ----------
if (missing(startdate) != missing(enddate)) stop("Using either startdate or enddate requries supplying both. Please provide both if a date range is wanted")
if (!(missing(startdate) & missing(enddate))) {
#
# something here to check the inputs but i'll come back to this
#
date_url <- paste0("date=", startdate, ":", enddate)
param_url_list[length(param_url_list) + 1] <- date_url
}
# check mrv ----------
if (!missing(mrv)) {
if (!is.numeric(mrv)) stop("If supplied, mrv must be numeric")
mrv_url <- paste0("MRV=", round(mrv, digits = 0)) # just to make sure its a whole number
param_url_list[length(param_url_list) + 1] <- mrv_url
}
# check gapfill ----------
if (!missing(gapfill)) {
if (!is.logical(gapfill)) stop("If supplied, values for gapfill must be TRUE or FALSE")
if (missing(mrv)) stop("mrv must be supplied for gapfill to be used")
gapfill_url <- paste0("Gapfill=", ifelse(gapfill, "Y", "N"))
param_url_list[length(param_url_list) + 1] <- gapfill_url
}
# check freq ----------
if (!missing(freq)) {
if (!freq %in% c("Y", "Q", "M")) stop("If supplied, values for freq must be one of the following 'Y' (yearly), 'Q' (Quarterly), or 'M' (Monthly)")
freq_url <- paste0("frequency=", freq)
param_url_list[length(param_url_list) + 1] <- freq_url
}
# combine the url parameters ----------
param_url_list[length(param_url_list) + 1] <- utils_url
param_url <- paste0(param_url_list, collapse = "&")
# make API calls ----------
df_list <- lapply(indicator, FUN = function(i) {
full_url <- paste0(base_url, lang, "/countries/", country_url, "/indicators/", i, "?", param_url)
return_df <- try(wbget(full_url, indicator = i), silent = FALSE)
}
)
# remove the errored out indicator returns ----------
df_index <- sapply(df_list, is.data.frame)
out_list <- df_list[df_index]
# "defaultName" = "newName"
out_cols <- c("value" = "value",
"decimal" = "decimal",
"date" = "date",
"indicator.id" = "indicatorID",
"indicator.value" = "indicator",
"country.id" = "iso2c",
"country.value" = "country",
"countryiso3code" = "iso3c",
"obs_status" = "obsStatus",
"unit" = "unit")
if (length(out_list) == 0) {
warning("No data was returned for any requested country and indicator. Returning empty data frame")
out_df <- as.data.frame(matrix(nrow = 0, ncol = length(out_cols)))
names(out_df) <- names(out_cols)
} else {
out_df <- do.call("rbind", out_list)
}
# a little clean up ----------
out_df$value <- as.numeric(out_df$value)
out_df <- wbformatcols(out_df, out_cols)
if (POSIXct) out_df <- wbdate2POSIXct(out_df, "date")
if (!include_dec) out_df$decimal <- NULL
if (!include_unit) out_df$unit <- NULL
if (!include_obsStatus) out_df$obsStatus <- NULL
if (!include_lastUpdated) out_df$lastUpdated <- NULL
if (removeNA) out_df <- out_df[!is.na(out_df$value), ]
# Namibia bug ----------
# if only Namibia is requested it's iso2c code "NA" is automatically converted
# to logical NA by jsonlite::fromJSON and there currently does not seem to be an
# option to handle that within that function so look if thats the case and fix it
namibia_na <- which(is.na(out_df$iso2c) & out_df$country == "Namibia")
if (!length(namibia_na) == 0) out_df[namibia_na, "iso2c"] <- "NA"
# handle iso3c in iso2c bug ----------
iso3c_in_iso2c_cols <- which(out_df$iso2c %in% cache$countries$iso3c)
if (!length(iso3c_in_iso2c_cols) == 0) {
iso3c_in_iso2c <- unique(out_df[iso3c_in_iso2c_cols, "iso2c"])
iso23_df <- cache$countries[cache$countries$iso3c %in% iso3c_in_iso2c, c("iso2c","iso3c")]
for (i in 1:nrow(iso23_df)) {
replace_rows <- which(out_df$iso2c == iso23_df[i, "iso3c"])
out_df[replace_rows, "iso3c"] <- iso23_df[i,"iso3c"]
out_df[replace_rows, "iso2c"] <- iso23_df[i,"iso2c"]
}
}
# handle blank iso3c ----------
na_iso3c <- which(is.na(out_df$iso3c) & !(is.na(out_df$iso2c)))
if (!length(na_iso3c) == 0) {
iso2c <- unique(out_df[na_iso3c, "iso2c"])
iso23_df <- cache$countries[cache$countries$iso2c %in% iso2c, c("iso2c", "iso3c")]
for (i in 1:nrow(iso23_df)) {
replace_rows <- which(out_df$iso2c == iso23_df[i, "iso2c"])
out_df[replace_rows, "iso3c"] <- iso23_df[i, "iso3c"]
}
}
# check for wide return ----------
if (return_wide) {
out_df$indicator <- NULL
out_df <- tidyr::spread_(data = out_df,
key_col = "indicatorID",
value_col = "value")
}
out_df
}
nset-ornl/wbstats documentation built on March 6, 2021, 4:42 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Defines functions wb
Documented in wb
#' Download Data from the World Bank API
#'
#' This function downloads the requested information using the World Bank API
#'
#' @param country Character vector of country or region codes. Default value is special code of \code{all}.
#' Other permissible values are codes in the following fields from the \code{\link{wb_cachelist}} \code{country}
#' data frame. \code{iso3c}, \code{iso2c}, \code{regionID}, \code{adminID}, and \code{incomeID}.
#' Additional special values include \code{aggregates}, which returns only aggregates, and \code{countries_only},
#' which returns all countries without aggregates.
#' @param indicator Character vector of indicator codes. These codes correspond to the \code{indicatorID} column
#' from the \code{indicator} data frame of \code{\link{wbcache}} or \code{\link{wb_cachelist}}, or
#' the result of \code{\link{wbindicators}}
#' @param startdate Numeric or character. If numeric it must be in \%Y form (i.e. four digit year).
#' For data at the subannual granularity the API supports a format as follows: for monthly data, "2016M01"
#' and for quarterly data, "2016Q1". This also accepts a special value of "YTD", useful for more frequently
#' updated subannual indicators.
#' @param enddate Numeric or character. If numeric it must be in \%Y form (i.e. four digit year).
#' For data at the subannual granularity the API supports a format as follows: for monthly data, "2016M01"
#' and for quarterly data, "2016Q1".
#' @param mrv Numeric. The number of Most Recent Values to return. A replacement of \code{startdate} and \code{enddate},
#' this number represents the number of observations you which to return starting from the most recent date of collection.
#' Useful in conjuction with \code{freq}
#' @param return_wide Logical. If \code{TRUE} data is returned in a wide format instead of long, with a column named for each
#' \code{indicatorID}. To necessitate this transformation, the \code{indicator} column, that provides the human readable description
#' is dropped. This field is available through from the \code{indicator} data frame of \code{\link{wbcache}} or \code{\link{wb_cachelist}},
#' or the result of \code{\link{wbindicators}}. Default is \code{FALSE}
#' @param gapfill Logical. Works with \code{mrv}. If \code{TRUE} fills values, if not available, by back tracking to the
#' next available period (max number of periods back tracked will be limited by \code{mrv} number)
#' @param freq Character String. For fetching quarterly ("Q"), monthly("M") or yearly ("Y") values.
#' Currently works along with \code{mrv}. Useful for querying high frequency data.
#' @param cache List of data frames returned from \code{\link{wbcache}}. If omitted,
#' \code{\link{wb_cachelist}} is used
#' @param lang Language in which to return the results. If \code{lang} is unspecified,
#' english is the default.
#' @param removeNA if \code{TRUE}, remove any blank or \code{NA} observations that are returned.
#' if \code{FALSE}, no blank or \code{NA} values are removed from the return.
#' @param POSIXct if \code{TRUE}, additonal columns \code{date_ct} and \code{granularity} are added.
#' \code{date_ct} converts the default date into a \code{\link[base]{POSIXct}}. \code{granularity}
#' denotes the time resolution that the date represents. Useful for subannual data and mixing subannual
#' with annual data. If \code{FALSE}, these fields are not added.
#' @param include_dec if \code{TRUE}, the column \code{decimal} is not removed from the return. if \code{FALSE},
#' this column is removed
#' @param include_unit if \code{TRUE}, the column \code{unit} is not removed from the return. if \code{FALSE},
#' this column is removed
#' @param include_obsStatus if \code{TRUE}, the column \code{obsStatus} is not removed from the return. if \code{FALSE},
#' this column is removed
#' @param include_lastUpdated if \code{TRUE}, the column \code{lastUpdated} is not removed from the return. if \code{FALSE},
#' this column is removed. If \code{TRUE} and \code{POSIXct = TRUE} then column will be of class \code{\link[base]{Date}}
#' @return Data frame with all available requested data.
#'
#' @note Not all data returns have support for langauges other than english. If the specific return
#' does not support your requested language by default it will return \code{NA}. For an enumeration of
#' supported languages by data source please see \code{\link{wbdatacatalog}}.
#' The options for \code{lang} are:
#' \itemize{
#' \item \code{en}: English
#' \item \code{es}: Spanish
#' \item \code{fr}: French
#' \item \code{ar}: Arabic
#' \item \code{zh}: Mandarin
#' }
#' The \code{POSIXct} parameter requries the use of \code{\link[lubridate]{lubridate}} (>= 1.5.0). All dates
#' are rounded down to the floor. For example a value for the year 2016 would have a \code{POSIXct} date of
#' \code{2016-01-01}. If this package is not available and the \code{POSIXct} parameter is set to \code{TRUE},
#' the parameter is ignored and a \code{warning} is produced.
#'
#' The \code{include_dec}, \code{include_unit}, and \code{include_obsStatus} are defaulted to \code{FALSE}
#' because as of writing, all returns have a value of \code{0}, \code{NA}, and \code{NA}, respectively.
#' These columns might be used in the future by the API, therefore the option to include the column is available.
#'
#' The \code{include_lastUpdated} is defaulted to \code{FALSE} as well to limit the
#'
#' If there is no data available that matches the request parameters, an empty data frame is returned along with a
#' \code{warning}. This design is for easy aggregation of multiple calls.
#'
#' @examples
#' # GDP at market prices (current US$) for all available countries and regions
#' \donttest{wb(indicator = "NY.GDP.MKTP.CD", startdate = 2000, enddate = 2016)}
#'
#' # GDP and Population in long format for the most recent 20 observations
#' \donttest{wb(indicator = c("SP.POP.TOTL","NY.GDP.MKTP.CD"), mrv = 20)}
#'
#' # GDP and Population in wide format for the most recent 20 observations
#' \donttest{wb(indicator = c("SP.POP.TOTL","NY.GDP.MKTP.CD"), mrv = 20, return_wide = TRUE)}
#'
#' # query using regionID or incomeID
#' # High Income Countries and Sub-Saharan Africa (all income levels)
#' wb(country = c("HIC", "SSF"), indicator = "NY.GDP.MKTP.CD", startdate = 1985, enddate = 1985)
#'
#' # if you do not know when the latest time an indicator is avaiable mrv can help
#' wb(country = c("IN"), indicator = 'EG.ELC.ACCS.ZS', mrv = 1)
#'
#' # increase the mrv value to increase the number of maximum number of returns
#' wb(country = c("IN"), indicator = 'EG.ELC.ACCS.ZS', mrv = 35)
#'
#' # GDP at market prices (current US$) for only available countries
#' \donttest{wb(country = "countries_only", indicator = "NY.GDP.MKTP.CD", startdate = 2000, enddate = 2016)}
#'
#' # GDP at market prices (current US$) for only available aggregate regions
#' \donttest{wb(country = "aggregates", indicator = "NY.GDP.MKTP.CD", startdate = 2000, enddate = 2016)}
#'
#' # if you want to "fill-in" the values in between actual observations use gapfill = TRUE
#' # this highlights a very important difference.
#' # all other parameters are the same as above, except gapfill = TRUE
#' # and the results are very different
#' wb(country = c("IN"), indicator = 'EG.ELC.ACCS.ZS', mrv = 35, gapfill = TRUE)
#'
#' # if you want the most recent values within a certain time frame
#' wb(country = c("US"), indicator = 'SI.DST.04TH.20', startdate = 1970, enddate = 2000, mrv = 2)
#'
#' # without the freq parameter the deafult temporal granularity search is yearly
#' # should return the 12 most recent years of data
#' wb(country = c("CHN", "IND"), indicator = "DPANUSSPF", mrv = 12)
#'
#' # if another frequency is available for that indicator it can be accessed using the freq parameter
#' # should return the 12 most recent months of data
#' wb(country = c("CHN", "IND"), indicator = "DPANUSSPF", mrv = 12, freq = "M")
#' @export
wb <- function(country = "all", indicator, startdate, enddate, mrv, return_wide = FALSE, gapfill,
freq, cache, lang = c("en", "es", "fr", "ar", "zh"), removeNA = TRUE, POSIXct = FALSE,
include_dec = FALSE, include_unit = FALSE, include_obsStatus = FALSE, include_lastUpdated = FALSE) {
lifecycle::deprecate_soft("1.0.0", "wbstats::wb()", "wbstats::wb_data()")
lang <- match.arg(lang)
url_list <- wburls()
base_url <- url_list$base_url
utils_url <- url_list$utils_url
if (missing(cache)) cache <- wbstats::wb_cachelist_dep
# check country ----------
if ("all" %in% country) {
country_url <- "all"
} else if ("aggregates" %in% country) {
cache_cn <- cache$countries[cache$countries$region == "Aggregates" , "iso3c" ]
country_url <- paste0(cache_cn, collapse = ";")
} else if ("countries_only" %in% country) {
cache_cn <- cache$countries[cache$countries$region != "Aggregates" , "iso3c" ]
country_url <- paste0(cache_cn, collapse = ";")
} else {
cache_cn <- cache$countries
cn_check <- cache_cn[ , c("iso3c", "iso2c", "regionID", "adminID", "incomeID")]
cn_check <- unique(unlist(cn_check, use.names = FALSE))
cn_check <- cn_check[!is.na(cn_check)]
good_cn_index <- country %in% cn_check
good_cn <- country[good_cn_index]
if (length(good_cn) == 0) stop("country parameter has no valid values. Please check documentation for valid inputs")
bad_cn <- country[!good_cn_index]
if (length(bad_cn) > 0) warning(paste0("The following country values are not valid and are being excluded from the request: ",
paste(bad_cn, collapse = ",")))
country_url <- paste0(good_cn, collapse = ";")
}
# check indicator ----------
cache_ind <- cache$indicators
ind_check <- cache_ind[, "indicatorID"]
ind_check <- ind_check[!is.na(ind_check)] # should never be needed but make sure
good_ind_index <- indicator %in% ind_check
good_ind <- indicator[good_ind_index]
if (length(good_ind) == 0) stop("indicator parameter has no valid values. Please check documentation for valid inputs")
bad_ind <- indicator[!good_ind_index]
if (length(bad_ind) > 0) warning(paste0("The following indicator values are not valid and are being excluded from the request: ",
paste(bad_ind, collapse = ",")))
## check date and other parameters. add to list if not missing ----------
param_url_list <- list()
# check dates ----------
if (missing(startdate) != missing(enddate)) stop("Using either startdate or enddate requries supplying both. Please provide both if a date range is wanted")
if (!(missing(startdate) & missing(enddate))) {
#
# something here to check the inputs but i'll come back to this
#
date_url <- paste0("date=", startdate, ":", enddate)
param_url_list[length(param_url_list) + 1] <- date_url
}
# check mrv ----------
if (!missing(mrv)) {
if (!is.numeric(mrv)) stop("If supplied, mrv must be numeric")
mrv_url <- paste0("MRV=", round(mrv, digits = 0)) # just to make sure its a whole number
param_url_list[length(param_url_list) + 1] <- mrv_url
}
# check gapfill ----------
if (!missing(gapfill)) {
if (!is.logical(gapfill)) stop("If supplied, values for gapfill must be TRUE or FALSE")
if (missing(mrv)) stop("mrv must be supplied for gapfill to be used")
gapfill_url <- paste0("Gapfill=", ifelse(gapfill, "Y", "N"))
param_url_list[length(param_url_list) + 1] <- gapfill_url
}
# check freq ----------
if (!missing(freq)) {
if (!freq %in% c("Y", "Q", "M")) stop("If supplied, values for freq must be one of the following 'Y' (yearly), 'Q' (Quarterly), or 'M' (Monthly)")
freq_url <- paste0("frequency=", freq)
param_url_list[length(param_url_list) + 1] <- freq_url
}
# combine the url parameters ----------
param_url_list[length(param_url_list) + 1] <- utils_url
param_url <- paste0(param_url_list, collapse = "&")
# make API calls ----------
df_list <- lapply(indicator, FUN = function(i) {
full_url <- paste0(base_url, lang, "/countries/", country_url, "/indicators/", i, "?", param_url)
return_df <- try(wbget(full_url, indicator = i), silent = FALSE)
}
)
# remove the errored out indicator returns ----------
df_index <- sapply(df_list, is.data.frame)
out_list <- df_list[df_index]
# "defaultName" = "newName"
out_cols <- c("value" = "value",
"decimal" = "decimal",
"date" = "date",
"indicator.id" = "indicatorID",
"indicator.value" = "indicator",
"country.id" = "iso2c",
"country.value" = "country",
"countryiso3code" = "iso3c",
"obs_status" = "obsStatus",
"unit" = "unit")
if (length(out_list) == 0) {
warning("No data was returned for any requested country and indicator. Returning empty data frame")
out_df <- as.data.frame(matrix(nrow = 0, ncol = length(out_cols)))
names(out_df) <- names(out_cols)
} else {
out_df <- do.call("rbind", out_list)
}
# a little clean up ----------
out_df$value <- as.numeric(out_df$value)
out_df <- wbformatcols(out_df, out_cols)
if (POSIXct) out_df <- wbdate2POSIXct(out_df, "date")
if (!include_dec) out_df$decimal <- NULL
if (!include_unit) out_df$unit <- NULL
if (!include_obsStatus) out_df$obsStatus <- NULL
if (!include_lastUpdated) out_df$lastUpdated <- NULL
if (removeNA) out_df <- out_df[!is.na(out_df$value), ]
# Namibia bug ----------
# if only Namibia is requested it's iso2c code "NA" is automatically converted
# to logical NA by jsonlite::fromJSON and there currently does not seem to be an
# option to handle that within that function so look if thats the case and fix it
namibia_na <- which(is.na(out_df$iso2c) & out_df$country == "Namibia")
if (!length(namibia_na) == 0) out_df[namibia_na, "iso2c"] <- "NA"
# handle iso3c in iso2c bug ----------
iso3c_in_iso2c_cols <- which(out_df$iso2c %in% cache$countries$iso3c)
if (!length(iso3c_in_iso2c_cols) == 0) {
iso3c_in_iso2c <- unique(out_df[iso3c_in_iso2c_cols, "iso2c"])
iso23_df <- cache$countries[cache$countries$iso3c %in% iso3c_in_iso2c, c("iso2c","iso3c")]
for (i in 1:nrow(iso23_df)) {
replace_rows <- which(out_df$iso2c == iso23_df[i, "iso3c"])
out_df[replace_rows, "iso3c"] <- iso23_df[i,"iso3c"]
out_df[replace_rows, "iso2c"] <- iso23_df[i,"iso2c"]
}
}
# handle blank iso3c ----------
na_iso3c <- which(is.na(out_df$iso3c) & !(is.na(out_df$iso2c)))
if (!length(na_iso3c) == 0) {
iso2c <- unique(out_df[na_iso3c, "iso2c"])
iso23_df <- cache$countries[cache$countries$iso2c %in% iso2c, c("iso2c", "iso3c")]
for (i in 1:nrow(iso23_df)) {
replace_rows <- which(out_df$iso2c == iso23_df[i, "iso2c"])
out_df[replace_rows, "iso3c"] <- iso23_df[i, "iso3c"]
}
}
# check for wide return ----------
if (return_wide) {
out_df$indicator <- NULL
out_df <- tidyr::spread_(data = out_df,
key_col = "indicatorID",
value_col = "value")
}
out_df
}
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.