restore_paragraphs: Restore paragraphs

In PolMine/trickypdf: Turn tricky pdf into txt/xml for corpus preparation

Description

Restore paragraphs in a character vector.

Usage

restore_paragraphs(x, skipRegexCurrent = "^\\s*[•A-Z(]",
  skipRegexPrevious = "[\\.?!)]\\s*$")

Arguments

x	a character vector
skipRegexCurrent	a regex
skipRegexPrevious	another regex

Details

Reconstruct paragraphs from a character vector with line breaks and word-wraps. The heuristic is as follows: If a line ends with a hyphenation and the next line starts with a small letter, remove hyphen and concatenate word."

Examples

vec <- c(
  "This is a sample text. We freq-",
  "quently encounter issues with bro-",
  "ken lines."
  )
restore_paragraphs(vec)

PolMine/trickypdf documentation built on Nov. 20, 2019, 8:01 p.m.