createSimilarityTableSubstring: Similarity Table with Coding index

In malsch/occupationCoding: Supervised Learning for Occupation Coding

Similarity Table with Coding index

Description

Calculate SUBSTRING similarity between unique.string and (coding_index_w_codes, coding_index_without_codes). unique.string and coding_index are similar if coding_index is a substring of unique.string.

Usage

createSimilarityTableSubstring(
  unique.string,
  coding_index_w_codes,
  coding_index_without_codes
)

Arguments

unique.string	a character vector (usually unique(answer))
coding_index_w_codes	a data.table with columns "title" and "Code".
coding_index_without_codes	a character vector of additional titles

Details

Special function for similarity-based reasoning: creates distance data with substring-method

Value

a list with elements

dist_table_w_code

a data.table with colummns intString, dictString.title, dictString.Code, dist

dist_table_without_code

NULL or a data.table with colummns intString, dictString, dist

vect_vocab

see link{asDocumentTermMatrix}

See Also

trainSimilarityBasedReasoning, createSimilarityTableWordwiseStringdist, createSimilarityTableStringdist, createSimilarityTableStringdist

Examples

## Prepare coding index
# write female titles beneath the male title
coding_index <- rbind(coding_index_excerpt[, list(title = bezMale, Code)],
                      coding_index_excerpt[, list(title = bezFemale, Code)])
# standardize titles from the coding index
coding_index <- coding_index[,title := stringPreprocessing(title)]
# drop duplicate lines, might be suboptimal because we keep each title and its associated code only a single time. This means we delete duplicates and the associated, possibly relevant codes.
coding_index <- coding_index[!duplicated(title)]

(x <- c("Abgeordneter", "Abgeordneter", "Abgeordnete", "abgeordnet", "FSJ", "FSJ2", "Industriemechaniker", "Dipl.-Ing. - Agrarwirtschaft (Landwirtschaft)"))
createSimilarityTableSubstring(unique.string = stringPreprocessing(x),
                               coding_index_w_codes = coding_index,
                               coding_index_without_codes = frequent_phrases)

malsch/occupationCoding documentation built on March 14, 2024, 8:09 a.m.