In kanishkamisra/footrulr: Measure Quality of Machine Generated Texts

knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  fig.path = "man/figures/README-",
  out.width = "100%"
)

footrulr

The goal of footrulr is to provide some functionality to compute sentence comparisons using metrics frequently employed in Machine Translation and Text Summarization evaluation.

The name is inspired from Rstudio's yardstick package for Machine Learning evaluation metrics.

Installation

You can install the development version of footrulr from github with:

# install.packages("devtools")
devtools::install_github("kanishkamisra/footrulr")

Example

This is a basic example which shows you how to solve a common problem:

library(footrulr)

bleu_vec("the cat the cat on the mat", c("the cat is on the mat", "there is a cat on the mat"), n = 3)
bleu_vec("The dragon ate dragon the pineapple", c("A dragon ate a pineapple", "The pineapple was eaten by the dragon"), n = 1)