ingest_pds_tracks: Ingest Pelagic Data System tracks data

In WorldFishCenter/peskas.timor.data.pipeline: Functions to Implement the Timor Small Scale Fisheries Data Pipeline

Ingest Pelagic Data System tracks data

Description

Downloads Pelagic Data System (pds) trips information and uploads it to cloud storage services.

Usage

ingest_pds_tracks(log_threshold = logger::DEBUG)

Arguments

log_threshold

The (standard Apache logj4) log level used as a threshold for the logging infrastructure. See logger::log_levels for more details

Details

The function downloads and uploads only tracks data that are not yet stored in the bucket.

The parameters needed in conf.yml are:

pds:
  tracks:
    token:
    secret:
    file_prefix:
pds_storage:
  storage_name:
    key:
    options:
      project:
      bucket:
      service_account_key:

Progress through the function is tracked using the package logger.

Value

No output. This funcrion is used for it's side effects

WorldFishCenter/peskas.timor.data.pipeline documentation built on April 14, 2025, 1:47 p.m.