inst/ShinyItemAnalysis/ui/uiReliability.R
In patriciamar/ShinyItemAnalysis: Test and Item Analysis via Shiny
uiReliability <-
navbarMenu(
"Reliability",
menuName = "Reliability",
# "Description",
## * RELIABILITY ####
# tabPanel("Reliability",
# value = "reliability_description",
# h3("Reliability"),
# p("We are typically interested in the unobserved true score \\(T\\), but normally have available only the
# observed score \\(X\\) which is contaminated by some measurement error \\(e\\), so that
# \\(X = T + e\\) and the error term is uncorrelated with the true score."),
# h4("Equation"),
# p("Reliability is defined as the squared correlation of the true and observed score"),
#
# ("$$\\text{rel}(X) = \\text{cor}(T, X)^2$$"),
# p("Equivalently, reliability can be re-expressed as the ratio of the true score variance
# to the total observed variance"),
#
# ("$$\\text{rel}(X) = \\frac{\\sigma^2_T}{\\sigma^2_X}$$"),
# br()
# ),
# "----",
# "Used methods",
# * SPEARMAN-BROWN FORMULA ####
tabPanel(
"Spearman-Brown formula",
h3("Spearman-Brown formula"),
h4("Equation"),
p("Let \\(\\text{rel}(X)\\) be the reliability of the test composed of \\(I\\) equally precise
items measuring the same construct, \\(X = X_1 + ... + X_I\\).
Then for a test consisting of
\\(I^*\\) such items, that is for a test which is
\\(m = \\frac{I^*}{I}\\) times longer/shorter, the reliability would be"),
("$$\\text{rel}(X^*) = \\frac{m\\cdot \\text{rel}(X)}{1 + (m - 1)\\cdot\\text{rel}(X)}.$$"),
p("The Spearman-Brown formula can be used to determine reliability of a test with with a
different number of equally precise items measuring the same construct.
It can also be used to determine the necessary number of items to achieve
desired reliability."),
p(
"In the calculations below, ", strong("reliability of original data"), "is by
default set to the value of Cronbach's \\(\\alpha\\) for the dataset currently in use. The ",
strong("number of items in the original data"), "is
by default set to the number of items in the dataset currently in use. "
),
fluidRow(
column(
3,
numericInput(
inputId = "reliability_SBformula_reliability_original",
label = "Reliability of original data",
max = 0,
min = 1,
value = 0.7
)
),
column(
3,
numericInput(
inputId = "reliability_SBformula_items_original",
label = "Number of items in original data",
min = 1,
step = 1,
value = 20
)
)
),
# br(),
h4("Estimate of reliability with different number of items"),
p("Here you can calculate an estimate of reliability for a test consisting of a different number of
items. "),
fluidRow(column(
3,
numericInput(
inputId = "reliability_SBformula_items_new",
label = "Number of items in new data",
min = 1,
step = 1,
value = 30
)
)),
uiOutput("reliability_SBformula_reliability_text"),
# br(),
h4("Necessary number of items for required level of reliability"),
p("Here you can calculate the necessary number of items
to gain the required level of reliability. "),
fluidRow(column(
3,
numericInput(
inputId = "reliability_SBformula_reliability_new",
label = "Reliability of new data",
max = 0,
min = 1,
value = 0.8
)
)),
uiOutput("reliability_SBformula_items_text"),
br(),
h4("Selected R code"),
code(includeText("sc/reliability/sb.R"))
),
# * SPLIT-HALF METHOD ####
tabPanel(
"Split-half method",
h3("Split-half method"),
p("The split-half method uses the correlation between two subscores for an estimation of reliability.
The underlying assumption is that the two halves of the test (or even all items on the test) are
equally precise and measure the same underlying construct. The Spearman-Brown formula is then used to
correct the estimate for the number of items."),
h4("Equation"),
p("For a test with \\(I\\) items total score is calculated as \\(X = X_1 + ... + X_I\\).
Let \\(X^*_1\\) and \\(X^*_2\\) be total scores calculated from items found only in the first
and second subsets. The estimate of reliability is then given by the Spearman-Brown formula (Spearman, 1910; Brown, 1910)
with \\(m = 2\\)."),
("$$\\text{rel}(X) = \\frac{m\\cdot \\text{cor}(X^*_1, X^*_2)}{1 + (m - 1)\\cdot\\text{cor}(X^*_1, X^*_2)} =
\\frac{2\\cdot \\text{cor}(X^*_1, X^*_2)}{1 + \\text{cor}(X^*_1, X^*_2)}$$"),
p(
"You can choose below from different split-half approaches. The ",
strong("First-last"), "method uses a correlation between the first half of items and the second
half of items. The ", strong("Even-odd"), "method places even numbered items into the first subset and odd numbered items
into the second one. The ", strong("Random"), "method performs a random split of items, thus the
resulting estimate may be different for each call. Out of a specified number of random splits (10,000 by default),
the ", strong("Worst"), " method selects the lowest estimate and the ", strong("Average"), "method calculates the
average. In the case of an odd number of items, the first subset contains one more item than the second one."
),
uiOutput("reliability_splithalf_allpossible_text"),
br(),
fluidRow(
column(
3,
selectInput(
inputId = "reliability_splithalf_method",
label = "Split half method",
choices = c(
"First-last" = "firstlast",
"Even-odd" = "evenodd",
"Random" = "random",
"Worst" = "worst",
"Average" = "average"
),
selected = "First_last"
)
),
column(
4,
numericInput(
inputId = "reliability_splithalf_number",
label = textOutput("reliability_splithalf_number_label"),
value = 10000,
min = 1,
step = 1
)
)
),
conditionalPanel(
condition = "input.reliability_splithalf_method != 'average'",
uiOutput("reliability_splithalf_text"),
br()
),
h4("Reliability estimate with confidence interval"),
p(
"The estimate of reliability for ", strong("First-last"), ", ", strong("Even-odd"), ", ", strong("Random"), "and",
strong("Worst"), "is calculated using the Spearman-Brown formula. The confidence interval is based on a
confidence interval of correlation using the delta method. The estimate of reliability for the ", strong("Average"),
"method is a mean value of sampled reliabilities and the confidence interval is the confidence interval of this mean. "
),
uiOutput("reliability_splithalf_table"),
br(),
h4("Histogram of reliability estimates"),
p("A histogram is based on a selected number of split halves estimates (10,000 by default).
The current estimate is highlighted by a red colour."),
plotlyOutput("reliability_splithalf_histogram"),
downloadButton("DB_reliability_splithalf_histogram"),
br(),
h4("Selected R code"),
code(includeText("sc/reliability/sh.R"))
),
# * CRONBACH'S ALPHA ####
tabPanel("Cronbach's \\(\\alpha\\)",
value = "cronbach",
h3("Cronbach's \\(\\alpha\\)"),
p("Cronbach's \\(\\alpha\\) is an estimate of the internal consistency of a psychometric test.
It is a function of the number of items in a test, the average covariance
between item-pairs, and the variance of the total score (Cronbach, 1951)."),
h4("Equation"),
p("For a test with \\(I\\) items where \\(X = X_1 + ... + X_I\\) is a total score,
\\(\\sigma^2_X\\) its variance and \\(\\sigma^2_{X_i}\\) variances of items,
Cronbach's \\(\\alpha\\) is given by following equation"),
("$$\\alpha = \\frac{I}{I-1}\\left(1 - \\frac{\\sum_{i = 1}^I \\sigma^2_{X_i}}{\\sigma^2_X}\\right)$$"),
h4("Estimate with confidence interval"),
p("A confidence interval is based on F distribution as proposed by Feldt et al. (1987)."),
tableOutput("reliability_cronbachalpha_table"),
# h3("McDonald's \\(\\omega\\)"),
# p(),
# br(),
h4("Selected R code"),
code(includeText("sc/reliability/cronbach.R"))
),
# * INTRA-CLASS CORRELATION ####
# tabPanel("Intra-class correlation",
# value = "ICC",
# h3("Intra-class correlation"),
# p("More generally, Cronbach's \\(\\alpha\\) is equivalent to intraclass correlation under one of the ANOVA models."),
# tableOutput("reliability_icc_table"), # preview, under construction
# h4("Selected R code"),
# div(code(HTML("library(psych)<br>library(tidyverse)<br><br># loading and formatting data<br>data(AIBS, package = \"ShinyItemAnalysis\")<br>AIBSwide <- AIBS %>%<br> pivot_wider(ID, values_from = Score, names_from = RevCode) %>%<br> select(-ID)<br>head(AIBSwide)<br><br>ICC(AIBSwide)<br>"))),
# br()
# ),
# "---",
# "Modules",
# tabPanel(tags$a("Range-restricted Reliability",
# href = "https://shiny.cs.cas.cz/ShinyItemAnalysis-module-IRRrestricted/",
# target = "_blank", .noWS = "outside"
# ))
)
patriciamar/ShinyItemAnalysis documentation built on April 29, 2024, 10:46 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
uiReliability <-
navbarMenu(
"Reliability",
menuName = "Reliability",
# "Description",
## * RELIABILITY ####
# tabPanel("Reliability",
# value = "reliability_description",
# h3("Reliability"),
# p("We are typically interested in the unobserved true score \\(T\\), but normally have available only the
# observed score \\(X\\) which is contaminated by some measurement error \\(e\\), so that
# \\(X = T + e\\) and the error term is uncorrelated with the true score."),
# h4("Equation"),
# p("Reliability is defined as the squared correlation of the true and observed score"),
#
# ("$$\\text{rel}(X) = \\text{cor}(T, X)^2$$"),
# p("Equivalently, reliability can be re-expressed as the ratio of the true score variance
# to the total observed variance"),
#
# ("$$\\text{rel}(X) = \\frac{\\sigma^2_T}{\\sigma^2_X}$$"),
# br()
# ),
# "----",
# "Used methods",
# * SPEARMAN-BROWN FORMULA ####
tabPanel(
"Spearman-Brown formula",
h3("Spearman-Brown formula"),
h4("Equation"),
p("Let \\(\\text{rel}(X)\\) be the reliability of the test composed of \\(I\\) equally precise
items measuring the same construct, \\(X = X_1 + ... + X_I\\).
Then for a test consisting of
\\(I^*\\) such items, that is for a test which is
\\(m = \\frac{I^*}{I}\\) times longer/shorter, the reliability would be"),
("$$\\text{rel}(X^*) = \\frac{m\\cdot \\text{rel}(X)}{1 + (m - 1)\\cdot\\text{rel}(X)}.$$"),
p("The Spearman-Brown formula can be used to determine reliability of a test with with a
different number of equally precise items measuring the same construct.
It can also be used to determine the necessary number of items to achieve
desired reliability."),
p(
"In the calculations below, ", strong("reliability of original data"), "is by
default set to the value of Cronbach's \\(\\alpha\\) for the dataset currently in use. The ",
strong("number of items in the original data"), "is
by default set to the number of items in the dataset currently in use. "
),
fluidRow(
column(
3,
numericInput(
inputId = "reliability_SBformula_reliability_original",
label = "Reliability of original data",
max = 0,
min = 1,
value = 0.7
)
),
column(
3,
numericInput(
inputId = "reliability_SBformula_items_original",
label = "Number of items in original data",
min = 1,
step = 1,
value = 20
)
)
),
# br(),
h4("Estimate of reliability with different number of items"),
p("Here you can calculate an estimate of reliability for a test consisting of a different number of
items. "),
fluidRow(column(
3,
numericInput(
inputId = "reliability_SBformula_items_new",
label = "Number of items in new data",
min = 1,
step = 1,
value = 30
)
)),
uiOutput("reliability_SBformula_reliability_text"),
# br(),
h4("Necessary number of items for required level of reliability"),
p("Here you can calculate the necessary number of items
to gain the required level of reliability. "),
fluidRow(column(
3,
numericInput(
inputId = "reliability_SBformula_reliability_new",
label = "Reliability of new data",
max = 0,
min = 1,
value = 0.8
)
)),
uiOutput("reliability_SBformula_items_text"),
br(),
h4("Selected R code"),
code(includeText("sc/reliability/sb.R"))
),
# * SPLIT-HALF METHOD ####
tabPanel(
"Split-half method",
h3("Split-half method"),
p("The split-half method uses the correlation between two subscores for an estimation of reliability.
The underlying assumption is that the two halves of the test (or even all items on the test) are
equally precise and measure the same underlying construct. The Spearman-Brown formula is then used to
correct the estimate for the number of items."),
h4("Equation"),
p("For a test with \\(I\\) items total score is calculated as \\(X = X_1 + ... + X_I\\).
Let \\(X^*_1\\) and \\(X^*_2\\) be total scores calculated from items found only in the first
and second subsets. The estimate of reliability is then given by the Spearman-Brown formula (Spearman, 1910; Brown, 1910)
with \\(m = 2\\)."),
("$$\\text{rel}(X) = \\frac{m\\cdot \\text{cor}(X^*_1, X^*_2)}{1 + (m - 1)\\cdot\\text{cor}(X^*_1, X^*_2)} =
\\frac{2\\cdot \\text{cor}(X^*_1, X^*_2)}{1 + \\text{cor}(X^*_1, X^*_2)}$$"),
p(
"You can choose below from different split-half approaches. The ",
strong("First-last"), "method uses a correlation between the first half of items and the second
half of items. The ", strong("Even-odd"), "method places even numbered items into the first subset and odd numbered items
into the second one. The ", strong("Random"), "method performs a random split of items, thus the
resulting estimate may be different for each call. Out of a specified number of random splits (10,000 by default),
the ", strong("Worst"), " method selects the lowest estimate and the ", strong("Average"), "method calculates the
average. In the case of an odd number of items, the first subset contains one more item than the second one."
),
uiOutput("reliability_splithalf_allpossible_text"),
br(),
fluidRow(
column(
3,
selectInput(
inputId = "reliability_splithalf_method",
label = "Split half method",
choices = c(
"First-last" = "firstlast",
"Even-odd" = "evenodd",
"Random" = "random",
"Worst" = "worst",
"Average" = "average"
),
selected = "First_last"
)
),
column(
4,
numericInput(
inputId = "reliability_splithalf_number",
label = textOutput("reliability_splithalf_number_label"),
value = 10000,
min = 1,
step = 1
)
)
),
conditionalPanel(
condition = "input.reliability_splithalf_method != 'average'",
uiOutput("reliability_splithalf_text"),
br()
),
h4("Reliability estimate with confidence interval"),
p(
"The estimate of reliability for ", strong("First-last"), ", ", strong("Even-odd"), ", ", strong("Random"), "and",
strong("Worst"), "is calculated using the Spearman-Brown formula. The confidence interval is based on a
confidence interval of correlation using the delta method. The estimate of reliability for the ", strong("Average"),
"method is a mean value of sampled reliabilities and the confidence interval is the confidence interval of this mean. "
),
uiOutput("reliability_splithalf_table"),
br(),
h4("Histogram of reliability estimates"),
p("A histogram is based on a selected number of split halves estimates (10,000 by default).
The current estimate is highlighted by a red colour."),
plotlyOutput("reliability_splithalf_histogram"),
downloadButton("DB_reliability_splithalf_histogram"),
br(),
h4("Selected R code"),
code(includeText("sc/reliability/sh.R"))
),
# * CRONBACH'S ALPHA ####
tabPanel("Cronbach's \\(\\alpha\\)",
value = "cronbach",
h3("Cronbach's \\(\\alpha\\)"),
p("Cronbach's \\(\\alpha\\) is an estimate of the internal consistency of a psychometric test.
It is a function of the number of items in a test, the average covariance
between item-pairs, and the variance of the total score (Cronbach, 1951)."),
h4("Equation"),
p("For a test with \\(I\\) items where \\(X = X_1 + ... + X_I\\) is a total score,
\\(\\sigma^2_X\\) its variance and \\(\\sigma^2_{X_i}\\) variances of items,
Cronbach's \\(\\alpha\\) is given by following equation"),
("$$\\alpha = \\frac{I}{I-1}\\left(1 - \\frac{\\sum_{i = 1}^I \\sigma^2_{X_i}}{\\sigma^2_X}\\right)$$"),
h4("Estimate with confidence interval"),
p("A confidence interval is based on F distribution as proposed by Feldt et al. (1987)."),
tableOutput("reliability_cronbachalpha_table"),
# h3("McDonald's \\(\\omega\\)"),
# p(),
# br(),
h4("Selected R code"),
code(includeText("sc/reliability/cronbach.R"))
),
# * INTRA-CLASS CORRELATION ####
# tabPanel("Intra-class correlation",
# value = "ICC",
# h3("Intra-class correlation"),
# p("More generally, Cronbach's \\(\\alpha\\) is equivalent to intraclass correlation under one of the ANOVA models."),
# tableOutput("reliability_icc_table"), # preview, under construction
# h4("Selected R code"),
# div(code(HTML("library(psych)<br>library(tidyverse)<br><br># loading and formatting data<br>data(AIBS, package = \"ShinyItemAnalysis\")<br>AIBSwide <- AIBS %>%<br> pivot_wider(ID, values_from = Score, names_from = RevCode) %>%<br> select(-ID)<br>head(AIBSwide)<br><br>ICC(AIBSwide)<br>"))),
# br()
# ),
# "---",
# "Modules",
# tabPanel(tags$a("Range-restricted Reliability",
# href = "https://shiny.cs.cas.cz/ShinyItemAnalysis-module-IRRrestricted/",
# target = "_blank", .noWS = "outside"
# ))
)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.