View source: R/measures_pairs.R
balanced_accuracy_pairs | R Documentation |
Computes the balanced accuracy of a set of predicted coreferent (linked) pairs given a set of ground truth coreferent pairs.
balanced_accuracy_pairs(true_pairs, pred_pairs, num_pairs, ordered = FALSE)
true_pairs |
set of true coreferent pairs stored in a matrix or data.frame, where rows index pairs and columns index the ids of the constituents. Any pairs not included are assumed to be non-coreferent. Duplicate pairs (including equivalent pairs with reversed ids) are automatically removed. |
pred_pairs |
set of predicted coreferent pairs, following the same
specification as |
num_pairs |
the total number of coreferent and non-coreferent pairs, excluding equivalent pairs with reversed ids. |
ordered |
whether to treat the element pairs as ordered—i.e. whether
pair |
The balanced accuracy is defined as:
\frac{\frac{|T \cap P|}{|P|} + \frac{|T' \cap P'|}{|P'|}}{2}
where:
T
is the set of true coreferent pairs,
P
is the set of predicted coreferent pairs,
T'
is the set of true non-coreferent pairs, and
P'
is the set of predicted non-coreferent pairs.
true_pairs <- rbind(c(1,2), c(2,3), c(1,3)) # ground truth is 3-clique
pred_pairs <- rbind(c(1,2), c(2,3)) # prediction misses one edge
num_pairs <- 3 # assuming 3 elements
balanced_accuracy_pairs(true_pairs, pred_pairs, num_pairs)
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.