NEWS.md

In quallmer.app: Interactive Validation App for 'quallmer'

quallmer.app 0.1.0

• Initial CRAN submission.
• Companion package to quallmer providing an interactive Shiny application for manual coding, LLM output review, and inter-rater reliability calculation.

• Three operating modes:

• Manual coding (blind): Text-focused interface for human annotation

• LLM checking: Review and validate LLM-generated annotations

• Validation/Agreement: Compute inter-rater reliability and gold-standard validation metrics

• Supports multiple measurement levels: nominal, ordinal, interval, and ratio.

• Computes reliability metrics including Krippendorff's alpha, Cohen's/Fleiss' kappa, ICC, and percent agreement.
• Automatic progress saving with resume capability.
• Includes sample dataset for demonstration and testing.

quallmer.app documentation built on March 8, 2026, 5:06 p.m.