NEWS.md

In ASRCsoft/atmoschem.datasets: ASRC Atmospheric Chemistry Data Processing

version (development version) Unreleased

Added

• Add 2021 3rd and 4th quarter WFMS, WFML, and PSP data flags.

version 0.7.0 2022-03-04

Added

• Add 2021 1st and 2nd quarter WFMS, WFML, and PSP data flags.

Changed

• Rename Whiteface Mountain lodge (WFML) to Whiteface Mountain base (WFMB).

Fixed

• Use correct units for Queens College CO.
• Fix PSP NO2 conversion efficiency calculations.
• Ignore incorrectly set WFMS temperature and relative humidity flags.
• Use outside temperatures for sea level pressure calculations (before 2018-10-01).

version 0.6.0 2021-10-15

Added

• Add 2020 3rd and 4th quarter WFMS, WFML, and PSP data flags.
• Add 2018-10-01 to 2021-01-01 Queens College data.
• Add recommended citations to README file.
• Add NARSTO flag definitions.
• Add pkgdown documentation website at https://asrcsoft.github.io/atmoschem.process/.
• Add Zenodo integration.

Fixed

• Use outside temperatures for sea level pressure calculations (starts 2018-10-01).
• Calculate resultant wind speeds instead of mean wind speeds for WFMS minute-resolution wind data (starts 2020-06-30).

version 0.5.0 2020-10-26

Added

• Add 2020 2nd quarter WFMS, WFML, and PSP data flags.
• Add site elevation to sites file.

Changed

• Use empty string instead of "NA" for missing values.
• Add rows for hours with no data.

Fixed

• Include Pinnacle PM2.5 before 2018-10-01.

version 0.4.0 2020-07-01

Added

• Add 2020 1st quarter WFMS, WFML, and PSP data flags.
• Add site information file.
• Add Addison Mesonet winds to PSP data.

Fixed

• Remove incorrect WFMS wind speed maximums.

version 0.3.0 2020-05-11

Added

• Add 2019 4th quarter WFMS, WFML, and PSP data flags.
• Add code for cleaning original processed routine data.
• Add Makefile and scripts for reproducing the routine chemistry dataset package.

Changed

• Prioritize V4 over V1 flags when both apply.
• Replace NA flag values with M1.
• Flag suspicious 1999-2001 WFMS CO drop as V4.
• Create unified dataset package instead of yearly data files.
• Reprocess all data starting from 2018-10-01.
• Set R package version number to match dataset version.

Fixed

• Flag data and ignore calibrations during WFMS 300EU auto-reference (AREF) periods.
• Correct a variety of WFMS and PSP wind direction issues in both the current and previously processed data.
• Replace zeros with NA during PSP black carbon tape changes.

version 0.1.3 2020-01-23

Added

• Add 2019 1st, 2nd, and 3rd quarter data annotations.
• Generate instrument info file with datasets.
• Interpolate calibrator instrument flow values.
• Add PSP aethelometer method detection limits.

Changed

• Simplify and standardize high time resolution dataset files.
• Improve PSP conversion efficiency calculations.
• Improve outlier detection in the presence of missing or flagged data.
• Flag more data at the end of auto-calibrations.
• Adjust WFMS perm tube calibration values based on GPT and IPN tests.
• Use unicode sub- and superscripts in generated dataset column names.
• Apply spike filter to WFMS ultrafine data.

version 0.1.2 2019-08-16

Added

• Add WFML 2018 4th quarter data annotations.
• Add manual flags for calibrations.
• Break calibration smoothing at instrument adjustment times.

Changed

• Apply smoothing to zero and span calibration values.

Fixed

• Convert NYS Mesonet data times to EST.

version 0.1.1 2019-06-10

Added

• Add WFMS 2018 4th quarter data annotations.

Changed

• Create separate minute files for each data source.
• Flag negative WFMS 370nm black carbon and wood smoke values as below the method detection limit.
• Treat zero WFMS 370nm and 880nm black carbon as missing data.

version 0.1.0 2019-05-31

Added

• Move raw data into PostgreSQL.
• Automate data processing.
• Add PSP 2018 4th quarter data annotations.

Changed

• Correct for clock errors using linear interpolation rather than by discarding measurements with overlapping times.
• Ignore ultrafine low pulse height flag.
• Replace standard deviation-based outlier detection with median absolute deviation-based outlier detection.
• Use 3-minute moving averages for all calibration estimates.
• Treat zero WindDir_SD1_WVT as an indicator of wind direction instrument malfunction.
• Apply M1 flag to hours with >50% missing data.
• Simplify data report format.

Fixed

• Fix bug ignoring ultrafine 'Nozzle Pressure' flag (400) instead of 'Service Reminder' flag (4000).
• Account for zero offsets when estimating calibration spans.
• Correct miscalculated WFMS wind speeds from 2016 to 2019.
• Fix PSP NO2 conversion efficiency calculations.
• Fix PSP solar radiation zero offset.

ASRCsoft/atmoschem.datasets documentation built on Feb. 15, 2023, 9:26 a.m.