NEWS.md

In KWB-R/wasserportal: R Package with Functions for Scraping Data of Wasserportal Berlin

wasserportal 0.4.0 2024-04-05

• New feature: add support for downloading all available surface water quality data for one or multiple monitoring stations. For details see get_surfacewater_qualities()
• Bugfix for groundwater level and quality due to new Wasserportal API
• Add project AD4GD as funder

wasserportal 0.3.0 2023-02-19

• Fix errors in GitHub actions: use actions from branches v2, v3, not from master
• Fix errors in tutorial.Rmd
• Fix errors in documentation
• Do not run examples that use parallel processing
• get_stations(): add argument n_cores
• get_wasserportal_stations_table(): Use new (three letter) variable codes
• read_wasserportal_raw(): adapt request to new API version, add argument api_version
• read_wasserportal_raw_gw(): adapt request to new API version
• Clean code, mainly to reduce duplicated duplication and to improve readability
• check for more errors
• use "safe" element selection
• use more helper functions
• use helper functions in vignettes
• improve names

wasserportal 0.2.0 2022-09-08

• Add functions for exporting time series data to zip files (wp_masters_data_to_list()) and master data to csv files (wp_timeseries_data_to_list()), which will be uploaded to https://kwb-r.github.io/wasserportal/<filename>

• In addition import functions for downloading and importing the datasets above into R as lists were added (list_timeseries_data_to_zip(), list_masters_data_to_csv())

• Code cleaning by @hsonne started

• Fix master data requests by using the master_url instead of station_id, as the latter was not unique. Now functions get_wasserportal_master_data() and it wrapper function get_wasserportal_masters_data() require the master_url instead of station_id as input parameter. The function get_stations now adds the column stammdaten_link as additional column for each sublist element of the sublist overview_list.

• Fix to scrape groundwater level data from all available monitoring stations (instead of only 5!) and export to .csv file. In addition switch also to .csv export for groundwater quality instead of .json due to reduced storage space (stations_gwq_data.json file is already 98.4 MB large.

• Add functions (get_daily_surfacewater_data()) and adapt article Surface Water for scraping all available daily surface water data and exporting to one .csv file for each parameter (containing all monitoring stations)

• Deactivate PROMISCES workflows (see wasserportal v0.1.0), due to failing Zenodo download. Will be moved into own R package, most properly kwb.promisces.

wasserportal 0.1.1 2022-06-09

• Fix bug in get_wasserportal_stations_table() now correctly naming parameter temperature (formerly incorrectly level)
• Fix Surface Water article
• Adapt Zenodo DOI badge to cite always latest release

wasserportal 0.1.0 2022-06-01

R package for scraping groundwater data (groundwater level and quality) from Wasserportal Berlin. Please note that the support for scraping surface water monitoring stations is currently very limited!

Functions:

• get_stations(): returns metadata for all available monitoring stations
• get_wasserportal_masters_data(): get master data for selected station_ids
• read_wasserportal_raw_gw(): enables the download of groundwater data. Checkout the Tutorial article how to use it for downloading one or multiple stations at once.
• read_wasserportal(): works for surface water monitoring stations, but is outdated, as it is based on an outdated static file with station/variable names (i.e. only for 11 instead of 82 stations currently provided!) instead of relying on new metadata provided online. This will be fixed within the next release. For progress on this issue checkout #21

Workflows:

• Tutorial article how to download groundwater level and quality data

• Further Usage by combining previously scraped (see tutorial above) data and performing some analysis:

• Groundwater, e.g. creating a map with GW level trends

• Two workflows (REACH UBA, Norman List) created within the project PROMISCES for assessing prevalence and the spatial distribution of persistent, mobile and toxic (PMT) substances in the Berlin groundwater, based on different PMT lists, i.e. REACH UBA or Norman List.

wasserportal 0.0.0.9000

• Added a NEWS.md file to track changes to the package.

• see https://style.tidyverse.org/news.html for writing a good NEWS.md

KWB-R/wasserportal documentation built on June 6, 2024, 10:26 a.m.