ingest_pds_trips: Ingest Pelagic Data System trips data

In WorldFishCenter/peskas.timor.data.pipeline: Functions to Implement the Timor Small Scale Fisheries Data Pipeline

Ingest Pelagic Data System trips data

Description

Downloads Pelagic Data System (pds) trips information and uploads it to cloud storage services.

Usage

ingest_pds_trips(log_threshold = logger::DEBUG)

Arguments

log_threshold

The (standard Apache logj4) log level used as a threshold for the logging infrastructure. See logger::log_levels for more details

Details

This function downloads trips information from Pelagic Data System devices. Afterwards it uploads this information to cloud services. File names used contain a versioning string that includes the date-time and, if available, the first 7 digits of the git commit sha. This is acomplished using add_version()

The parameters needed in conf.yml are:

pds:
  trips:
    token:
    secret:
    file_prefix:
pds_storage:
  storage_name:
    key:
    options:
      project:
      bucket:
      service_account_key:

Progress through the function is tracked using the package logger.

Value

No output. This funcrion is used for it's side effects

WorldFishCenter/peskas.timor.data.pipeline documentation built on April 14, 2025, 1:47 p.m.