ingest_landings_v1v3: Ingest Landings Survey data

In WorldFishCenter/peskas.timor.data.pipeline: Functions to Implement the Timor Small Scale Fisheries Data Pipeline

Ingest Landings Survey data

Description

Downloads landings information for multiple surveys collected using Kobo Toolbox and uploads it to cloud storage services.

Usage

ingest_landings_v1v3(log_threshold = logger::DEBUG)

Arguments

log_threshold

The (standard Apache logj4) log level used as a threshold for the logging infrastructure. See logger::log_levels for more details

Details

This function downloads the survey metadata and responses for multiple landing surveys (landings_1, landings_3). It then uploads this information to cloud services. File names contain a versioning string that includes the date-time and, if available, the first 7 digits of the git commit sha, accomplished using add_version().

The parameters needed in conf.yml are:

surveys:
  kobo_username:
  kobo_password:
  landings_1:
    file_prefix:
    asset_id:
  landings_3:
    file_prefix:
    asset_id:
storage:
  storage_name:
    key:
    options:
      project:
      bucket:
      service_account_key:

Progress through the function is tracked using the package logger.

Value

No output. This function is used for its side effects

WorldFishCenter/peskas.timor.data.pipeline documentation built on April 14, 2025, 1:47 p.m.