loadPrismaData: Load PRISMA Data Files

In yasong/PRISMA: Protocol Inspection and State Machine Analysis

Description

Loads files generated by the sally tool (see http://www.mlsec.org/sally/) and represents the data as binary token/ngrams x documents matrix. After loading, statistical tests are applied to find features which are not volatile nor constant. Co-occurring features are grouped to further compactify the data. See system.file("extdata","sallyPreprocessing.py", package="PRISMA") for a Python script which generates the corresponding .fsally file from a .sally file which reduce the loading time via loadPrismaData considerably.

Usage

loadPrismaData(path, maxLines = -1, fastSally = TRUE,
               alpha = 0.05, skipFeatureCorrelation=FALSE)

Arguments

path	path of the data file without the .sally extension. loadPrisma loads path.sally or path.fsally depending on the fastSally switch.
maxLines	maximal number of lines to read from the data file. -1 means to read all lines.
fastSally	should the fsally file be used, which drastically decreases loading time.
alpha	significance level for the feature tests. If NULL, all features are kept.
skipFeatureCorrelation	should the grouping of features based on correlation analysis be skipped.

Value

prismaData

data object representing the tokenized documents as features x samples matrix.

Author(s)

Tammo Krueger <[e-mail]>

References

See http://www.mlsec.org/sally/ for the sally utility.

Examples

# please see the vingette for examles
# please see system.file("extdata","asap.tar.gz", package="PRISMA") for
# an example sally output

yasong/PRISMA documentation built on May 24, 2019, 7:50 a.m.