chunked_es_loading: Add ESAdocs to Elastic in 100-doc chunks

Description Usage Arguments Value Examples

View source: R/bulk_ecosdocs.R

Description

The raw text of ESA docs can be rather large; rather than trying to hold all of the text for all docs in a single data.frame, then load the data.frame to Elastic in one fell swoop, we take a chunking approach. The raw text is read in to the data.frame with add_raw_txt for each doc in each 100-doc chunk, then that chunk is loaded using docs_bulk

Usage

1
chunked_es_loading(df, index = "esadocs", type)

Arguments

df

A docs data.frame from bulk_*_prep

index

The index into which documents are loaded

type

The document type in df

Value

Nothing; chunking messages are printed during processing

Examples

1
2
3
4
## Not run: 
chunked_es_loading(fr_dat, "esadocs", "federal_register")

## End(Not run)

jacob-ogre/esadocs documentation built on May 18, 2019, 8 a.m.