req_cache: Automatically cache requests

In httr2: Perform HTTP Requests and Process the Responses

Automatically cache requests

Description

Use req_perform() to automatically cache HTTP requests. Most API requests are not cacheable, but static files often are.

req_cache() caches responses to GET requests that have status code 200 and at least one of the standard caching headers (e.g. Expires, Etag, Last-Modified, Cache-Control), unless caching has been expressly prohibited with Cache-Control: no-store. Typically, a request will still be sent to the server to check that the cached value is still up-to-date, but it will not need to re-download the body value.

To learn more about HTTP caching, I recommend the MDN article HTTP caching.

Usage

req_cache(
  req,
  path,
  use_on_error = FALSE,
  debug = FALSE,
  max_age = Inf,
  max_n = Inf,
  max_size = 1024^3
)

Arguments

req	A request.
path	Path to cache directory. httr2 doesn't provide helpers to manage the cache, but if you want to empty it, you can use something like unlink(dir(cache_path, full.names = TRUE)).
use_on_error	If the request errors, and there's a cache response, should req_perform() return that instead of generating an error?
debug	When TRUE will emit useful messages telling you about cache hits and misses. This can be helpful to understand whether or not caching is actually doing anything for your use case.
max_n, max_age, max_size	Automatically prune the cache by specifying one or more of: max_age: to delete files older than this number of seconds. max_n: to delete files (from oldest to newest) to preserve at most this many files. max_size: to delete files (from oldest to newest) to preserve at most this many bytes. The cache pruning is performed at most once per minute.

Value

A modified HTTP request.

Examples

# GitHub uses HTTP caching for all raw files.
url <- paste0(
  "https://raw.githubusercontent.com/allisonhorst/palmerpenguins/",
  "master/inst/extdata/penguins.csv"
)
# Here I set debug = TRUE so you can see what's happening
req <- request(url) |> req_cache(tempdir(), debug = TRUE)

# First request downloads the data
resp <- req |> req_perform()

# Second request retrieves it from the cache
resp <- req |> req_perform()

httr2 documentation built on Nov. 14, 2023, 5:08 p.m.