README.md

In skvrnami/rimr: Deterministic record linkage in R

rimr

:construction:

The rimr package serves to help with deterministic record linkage.

Installation

You can install rimr from github with:

# install.packages("devtools")
devtools::install_github("skvrnami/rimr")

Example

See vignette for example.

TO DO:

Matching

based on:

• [x] exact equality
• [x] equality with tolerance (x - t <= x <= x + t)
• [ ] equality with tolerance with specified direction (e.g. x >= x & x <= x + t or x <= x & x <= x - t)
• [ ] equality with tolerance based on string distance
• [x] higher/lower than
• [x] higher than or equal to/lower than or equal to
• [x] contains string
• [ ] contains string separated by word boundaries (for matching change in women's names after marriage + after divorce)
• [x] removing duplicites based on finding the most similar person (exact match on specified columns)
• [x] allow methods other than strict equality for finding the most similar person (when there are more than 1 similar person, e.g. in the case of description of a person - using Jaccard distance for comparison of words in occupation of a person, see tests for example)

Workflow

• [x] Find all similar between 2 datasets
• [x] Find records not contained in the source dataset
• [x] Append missing records to the output
• [ ] Find all similar between sequence of datasets

Output

• [x] Create panel data
• [x] Joint dataset (source dataset enhanced by additional variables from the target dataset)

Other

• [ ] Check dbplyr for storing datasets
• [ ] Check algorithmic complexity (could be source grouped?)

Conceptual

• [ ] specify predicate before running find_all_similar function
• [ ] connecting filters with OR?

Diss-related

• [ ] check tolerance bounds (is it necessary to make +- tolerance for checking approximate year of birth?)
• [ ] check similarity of last names of women after getting married (could they be separated by dash?)
• [ ] https://developers.google.com/analytics/devguides/reporting/core/v3/reference#filters (filtering for substrings and regex)

skvrnami/rimr documentation built on June 6, 2019, 3:50 p.m.