In bryanwhiting/generalconference: General Conference text corpus and web scrapers

knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>"
)

The data structure includes the metadata of the talk with a nested dataframe with the paragraphs of the text.

Scrape a given talk

library(generalconference)

url <- "https://www.churchofjesuschrist.org/study/general-conference/2021/04/49nelson?lang=eng"
scrape_talk(url)

Simply unnest the paragraphs column to get all paragraphs for a talk:

scrape_talk(url) %>%
  tidyr::unnest(paragraphs)

Conference URLs

Pull all conference URLs for April, 1971:

df_conference <- scrape_conference_urls(1971, 4)
df_conference

Unnest to see sessions

df_conference %>%
  unnest(sessions)

Unnest to see the individual talk urls:

df_conference %>%
  unnest(sessions) %>%
  unnest(session_talk_urls)

bryanwhiting/generalconference documentation built on Dec. 19, 2021, 11:51 a.m.