README.md

rptPlus

(R Package Template Plus)

DOI

 

Boris Steipe,
Department of Biochemistry and Department of Molecular Genetics,
University of Toronto
Canada
<boris.steipe@utoronto.ca>

This README contains detailed information about how to work with this package. The associated Vignette can be previewed here. The package can be installed from GitHub with devtools::install_github("hyginn/rptPlus", build_opts = c("--no-resave-data", "--no-manual")) however this is not likely to be very useful, this repository is meant to be downloaded (as an RStudio project) and modified.

If any of this information is ambiguous, inaccurate, outdated, or incomplete, please check the most recent version of the package on GitHub and file an issue.

  1. About this package:      1.1 What it is ...
  2. Details ...      2.1. A new GitHub project      2.2. A new RStudio project      2.3. Download the rptPlus files      2.4. Customize the core        2.4.1. Getting attribution right      2.5. Save, check, commit, and push      2.6. Configuring your enhanced modules        2.6.1. Development vs. deployment        2.6.2. NEWS        2.6.3. CITATION        2.6.4. Packaged Data Files        2.6.5. Adding a Vignette        2.6.6. Importing Bioconductor Packages        2.6.7. A Secure Approach to Credentials        2.6.8. Compiled C++ code        2.6.9. A Shiny App        2.6.10. Considerations for Reproducible Research
  3. Develop
  4. What's in the box ...
  5. FAQ
  6. Notes
  7. Further reading
  8. Acknowledgements

1 About this package:

1.1 What it is ...

The rpt package an RStudio project that contains all the assets required in a simple R package. rptPlus builds on rpt and contains assets for more advanced topics and enhanced functionality: building a vignette, including compiled code, deploying a shiny app, and more. The package loosely follows the principles outlined in Hadley Wickham's R Packages book, is compatible with the CRAN manual on writing R-extensions and the Bioconductor package guidelines, and it embodies principles of Reproducible Research . This is the architecture and standard I require for student-built packages in projects and courses at the University of Toronto and elsewhere.1 rpt will get you started with a standard setup of:

[rptPlus] adds to this:

 

1.2 Who needs it ...

The assets packaged in rptPlus support R users and developers at all levels who wish to go beyond the most basic package-development needs.

 

1.3 How it works ...

First, explore the basics by building a sample package based on rpt. Then, create an empty project, linked to an empty GitHub repository. Fill it with the files from rptPlus. Then start developing.

This is all it takes, but the details take care. You will go through the following steps:

  1. Define your package name and create a new GitHub project;
  2. Make a new RStudio project on your local machine that is linked to your GitHub project;
  3. Download a ZIP archive of rptPlus and copy all the core files over to your project folder;
  4. Customize your files;
  5. Save, check, commit, and push to GitHub;
  6. Start developing.

That's all. Steps 1 to 3 are identical to the process you have used with rpt. Each step is described in detail below.

2 Details ...

 

Go through these instructions carefully, step by step.

 

2.0 Prerequisites

You need a current installation of R and RStudio, git, and a GitHub account that has been set up to connect to your RStudio projects. If any of this is new to you (or if you wish to brush up on the details), head over to Jenny Bryan's superb tutorial Happy Git and GitHub with R. You should also download the devtools and testthat packages from CRAN. In the RStudio console type:

install.packages(c("devtools", "testthat"))

 

2.1 A new GitHub project

Create a new, empty repository on GitHub and give it your package name.

 

2.2 A new RStudio project

Create a new RStudio project on your local machine that is linked to your GitHub repository and account.

The project directory will be created, the repository file will be downloaded, a new RStudio session will open in your directory, and R's "working directory" should be set to here.

Validate:

  1. In the console, type getwd(). This should print the correct directory.
  2. Make a small change to the README.md file, commit it and push it back to the remote repository:
    1. In the files pane, click on README.md to open the file in the editor. Make a small change (e.g. add the word "test"). Save the file.
    2. Click on the Version control icon in the editor window menu and choose Commit..., or choose ToolsVersion ControlCommit... from the menu.
    3. In the version control window, check the box next to README.md to "stage" the file, enter "test" as your "Commit message" and click Commit. This commits your edits to your local repository.
    4. Click the green Push up-arrow. This synchronizes your local repository with your remote repository on GitHub.
    5. Navigate to your GitHub repository, reload the page, and confirm that your edit has arrived in the README.md file in your GitHub repository.

Congratulate yourself if this has all worked. If not - don't continue. You need to fix whatever problem has arisen. In my experience, the most frequent issue is that someone has skipped a step that they thought was not important to them. Check carefully whether you have followed all the steps. In particular, if the problem is associated with git on your machine, or connecting RStudio to your GitHub repository, work through Jenny Bryan's Happy Git... first.

 

2.3 Download the rptPlus files

Download a ZIP archive of rptPlus and copy all the files over to your project folder.

Validate

In RStudio, open the ./dev directory. Open the file rptTwee.R and click on Source to load the function. Then type rptTwee() into the console. You should get a directory tree that looks approximately like this.

 --<your-package-name>/
   |__.gitignore
   |__.Rbuildignore
   |__.Rprofile
   |__data/
      |__rptGC.RData
   |__DESCRIPTION
   |__dev/
      |__checkEnds.R
      |__functionTemplate.R
      |__makeMD5.R
      |__rptTwee.R
   |__doc/
      |__rptPlusVignette.html
      |__rptPlusVignette.R
      |__rptPlusVignette.Rmd
   |__inst/
      |__CITATION
      |__extdata/
         |__test_lseq.dat
      |__scripts/
         |__benchmarkCodons.R
         |__scriptTemplate.R
      |__shiny-scripts/
         |__rptApp/
            |__app.R
   |__LICENSE
   |__man/
      |__cpp_codonSplitCpp.Rd
      |__lseq.Rd
      |__makeSeq.Rd
      |__rptGC.Rd
      |__rptPlus.Rd
      |__runRptApp.Rd
   |__MD5
   |__Meta/
      |__vignette.rds
   |__NAMESPACE
   |__NEWS
   |__R/
      |__lseq.R
      |__makeSeq.R
      |__RcppExports.R
      |__rptGC.R
      |__rptPlus.R
      |__runRptApp.R
      |__zzz.R
   |__README.md
   |__<your-package-name>.Rproj
   |__rptPlus.Rproj
   |__src/
      |__codonSplitCpp.cpp
      |__RcppExports.cpp
   |__tests/
      |__testthat.R
      |__testthat/
         |__helper-functions.R
         |__test_lseq.R
   |__vignettes/
      |__.gitignore
      |__rptPlusVignette.Rmd

If directories or files are missing, figure out where you went wrong.

 

2.4 Customize the core

The following steps customize the "core" files of your package in a way that is common to basically all packages. Items that are specific to the added "modules" of rptPlus are described in the next sections, with instructions on how to remove these modules if you don't need them. But remember: you can't commit empty directories, so make sure to keep a placeholder file in each directory until you replace it with your own.

 

DESCRIPTION

Modify the DESCRIPTION file as follows:

-      Package: rptPlus
+      Package: <your-package-name>

Type: Package

-      Title: R Package Template - enhanced
+      Title: <a title for your package>

-      Version: 1.0.0
+      Version: 0.1.0

-      Date: 2018-12-26
+      Date: <today-in-YYYY-MM-DD-format>

Authors@R: c(
-    person("Boris", "Steipe", email = "boris.steipe@utoronto.ca", role = c("aut", "cre"), comment = c(ORCID = "0000-0002-1134-6758"))
+     person("Boris", "Steipe", email = "boris.steipe@utoronto.ca", role = c("aut"), comment = c(ORCID = "0000-0002-1134-6758")),
+     person("<your-given-name>", "<your-family-name>", email = "<your-email-address>", role = c("aut","cre"), comment = c(ORCID = "<your-ORCID-ID>"))
    )

-      Description: A template for an RStudio project of an R package ...
+      Description: {A short description of the purpose of your package}

-      URL: https://github.com/hyginn/rptPlus
+      URL: https://github.com/<your-github-user-name>/<your-package-name>

License: file LICENSE
[...]

 

2.4.1 Getting attribution right

Giving credit is the currency of the FOSS (Free and Open Source Software) world which makes all of our work possible, licensing keeps it free. Take the time to get your attributions and licenses right; even if you think you don't really need this immediately it's good practice for good habits. Don't think you don't have to care: you automatically have a copyright to everything you write, and if you don't license it, no one can legally re-use it. Unfortunately, the common practices for attributing R package authorship are not consistent wherever there is more than one author (which is usually the case in academia). rptPlus adopts a consistent approach that is backward compatible with earlier practice.

Attribution and licensing only appear to be related. They serve distinct requirements and require distinct and specific mechanisms.

Credible attribution needs to identify who authored what in a way that that information is conveniently accessible.

Credible licensing needs to identify who has a copyright to what, and under which license it is released, in a standard document.

Having that considered, continue customising your files.

 

rptPlus.Rproj

You already have a <your-package-name>.Rproj configuration file for RStudio in the main directory. You can either overwrite that with the options defined in rptPlus.Rproj, or set the options individually under ToolsProject options... and delete rptPlus.Rproj. rptPlus.Rproj sets the following (significant) project options:

To implement these options: - In the Files pane, select <your-package-name>.Rproj and click on Delete. - Select rpt.Rproj and Rename it to <your-package-name>.Rproj. - Choose FileRecent Projects...<your-package-name> and reload your project.

Validate

The Environment pane should now have a Build tab.

 

2.5 Save, check, commit, and push

It's time to complete the first development cycle: save, check, commit, and push to the master branch on GitHub.

  1. Save all modified documents.
  2. Check your package. Click on the Build tab, then click on the Check icon. This runs package checking code that confirms that all required files are present and correctly formatted, and all tests pass. See below.
  3. Once your package check has passed without any errors, warnings or notes, click on the Version control icon in the editor window menu and choose Commit..., or choose ToolsVersion ControlCommit... from the menu.
  4. In the version control window, check the box next to all changed files to "stage" them, enter "Initial Commit" as your "Commit message" and click Commit. 5. Click the green Push up-arrow to synchronize your local repository with GitHub.
  5. Navigate to your GitHub repository, reload the page, and confirm that your edited files have arrived.

Your package check must pass without errors, warnings or notes. rpt passes the checks, and nothing you have done above should have changed this, if it was done correctly. Therefore something is not quite right if the checking code finds anything to complain about. Fix it now. You need a "known-good-state" to revert to, for debugging, in case problems arise later on.

Validate

Install your package from github and confirm that it can be loaded. In the console, type:

devtools::install_github("<your-user-name>/<your-package-name>")
library(<your-package-name>)
citation("<your-package-name>")
?lseq

This should install your package, and load the library. Attaching the library runs the .onAttach() function in ./R/zzz.R and displays the updated package name and authors.5 The citation() function creates a package citation from information it finds in the CITATION file - we haven't updated that yet, so the .The final command accesses the help page for the lseq() sample function that came with rptPlus, via R's help system. By confirming that this works, you are exercising functionality that is specific to the way R loads and manages packages and package metadata, none of which would work from information that has merely been left behind in your Workspace during development.

 

2.6 Configuring your enhanced modules

2.6.1 Development vs. deployment

You might want to work with a function that you use for development, but that should not become part of your deployed package. Or you might want to load packages to support your development needs that are not needed for your package functions. The .Rprofile file makes this easy: it can load libraries and source() files in your ./dev directory, but it has been added to .Rbuildignore so it will not be included in your package. Indeed, .Rprofile should NOT be used to manage package behaviour. Package startup and unload behaviour is managed from ./R/zzz.R instead.

For example, my R style guide dictates that every source file needs to include a comment # [END] as the last line, to verify that the file has been completely transmitted whenever it is shared. Of course, this only works if all files follow this convention, if some are forgotten then those appear to be incomplete. Therefore I use a function checkEnds() which is defined in ./dev/checkEnds.R. The function is source()ed from .Rprofile so I have it available when I am writing code, but it is not part of the actual package objectives so I don't deploy it in the package. Both the ./dev directory and the .Rprofile file are mentioned in .Rbuildignore, so both are not included in the final package.

This is especially useful for loading packages. Since I usually need to run checks for Bioconductor compatibility, I also load the BiocCheck package. That's convenient, but obviously does not need to be included in the package itself. Also, there are a number of Suggests: packages mentioned in the DESCRIPTION file. Since these are not required for the actual package function, the package installer does not download them. But we do need them e.g. for building a vignette. Thus we chack and warn from .Rprofile if they are not already present on your machine.

On startup, you will see a few messages about installed packages, these come from .Rprofile.

Verify that checkEnds() is listed as a function in your RStudio project's "Environment" pane. If it is missing, either you don't have an .Rprofile file, or something caused source()ing the file to be aborted during startup.

To add this functionality to your package:

To remove this functionality from your package:

 

2.6.2 NEWS

A NEWS file contains condensed information on significant changes to your code for every release. It is a standard convenience for users and a requirement of Bioconductor guidelines. CRAN allows a plain-text ./NEWS or ./inst/NEWS files or ./inst/NEWS.md in markdown format (using the CommonMark markdown specification), but Bioconductor requires release information to be provided in ./NEWS.

To keep this functionality in your package:

Validate - In the Build pane, choose MoreClean and Rebuild. Then type utils::news(package = "<your-package-name>") into the console. Your NEWS file should open in the Help pane.

To remove this functionality from your package:

 

2.6.3 CITATION

Basic package citation information can be extracted from your DESCRIPTION file, but if a CITATION file is present, it supersedes the autogenerated information. You need a CITATION file if your package is published, for example if you submit your package to Zenodo (see under "Reproducible Research" below), or if your package forms part of a published manuscript, in both these cases your CITATION includes information that is not part of the package DESCRIPTION. The sample file ./inst/CITATION file contains two citations: one to the package's GitHub repository, the other to the archived Zenodo version (which includes a doi:),

To keep this functionality in your package:

To remove this functionality from your package:

 

2.6.4 Packaged Data Files

rptPlus contains an example of exported data file, and an example of non-exported data.

2.6.4.1 Exported Data

Exported data is kept in the ./data directory as an .RData file. It is made available to the user through a load operation and then exists in the package namespace, much like the package's loaded functions. However, it also needs to be documented, and to produce the required documentation requires a file in the ./R directory. To produce the file, create a file with a valid Roxygen2 header, just like a function script, that describes the data. Name it with <name-of-your-data-object>.R, make sure you have an @export field. The actual script body is just a NULL statement.

To use exported data in your package:

This is the workflow I have used to create the exported genetic code dataset rptGC. Adapt it for your own purposes and copy/rename/edit ./R/rptGC.R.

nuc <- c("A", "G", "C", "T")
rptGC <- character()
for (c1 in nuc) {
  for (c2 in nuc) {
    for (c3 in nuc) {
      codon <- paste0(c1, c2, c3)
      rptGC[codon] <- Biostrings::GENETIC_CODE[codon]
    }
  }
}
save(rptGC, file="./data/rptGC.RData")

Validate Update the documentation to produce the .Rd file in the ./man/ directory, then re-build and re-install the package. Type:

?rptGC

... to open the help page, then try the examples.

To remove exported data from your package:

2.6.4.2 Non-exported Data

To use non-exported data in your package:

Place non-exported data in ./inst/extdata. You can access it with system.file(). For example I have provided ./inst/extdata/test-lseq.dat, a text file that contains five numbers that are used in the test-code for the lseq() sample function, the test code fetches it with:

system.file("extdata",
            "test-lseq.dat",
            package = "rptPlus",
            mustWork = TRUE)

Since such data files do not normally contain enough descriptive information, do yourself a favour and place the script that produced the dataset in ./inst/scripts!

To remove exported data from your package:

 

2.6.5 Adding a Vignette

Packages must contain documentation about the purpose of a package, what its use cases are and how they support the greater context of a user's needs. Simply collating the help files of a package's functions is not credible documentation. Great examples for vignettes are included with the Rcpp package. Vignettes are optional for CRAN packages, but required for Bioconductor. rptPlus contains a Bioconductor-compatible Vignette. It is built:

You can open the Vignette source in ./vignettes/rptPlusVignette.Rmd and explore the syntax.

To add a Vignette to your package:

Follow this workflow to add a Vignette to your package:

  1. Make a copy of ./vignettes/rptPlusVignette.Rmd and edit it following the instructions in the Vignette itself. At first, edit only the header information and metadata, then continue with the installation steps below, to verify that you have a "known-good-state" to continue from.
  2. "knit" your Vignette with (Cmd + Shift + K, or by clicking the Knit icon at the top of the edit pane) to verify what you are doing, and/or check the result by pasting the URL to knitr's output from the R Markdown tab of the console into your normal browser;
  3. When you are satisfied with your Vignette, build it with devtools::build_vignettes(). This builds your Vignettes and the Vignette index, and moves the html output as well as a copy of the Vignette source into the ./doc folder. (To repeat: you edit the source in the ./vignettes folder, it gets built and distributed via the ./doc folder.).

Validate the Vignette Index vignette(package = "rptPlus", lib.loc = "..") opens the index in a viewer for the "local" library. It should contain the original rptPlusVignette and your own Vignette.

  1. Install your package: in order for browseVignettes() or vignette(<vignette-name>) to work, your package needs to be installed in the default R library path. You can do this by typing devtools::install(build_vignettes = TRUE) in the console. (Note: To properly build vignettes when installing from GitHub with devtools::install_github(), you need to turn the default --no-build-vignettes argument for the build options off. Issue the command: devtools::install_github("<your-repository>", build_opts = c("--no-resave-data", "--no-manual")).6)

Validate your Vignette installation

All of the following should work:

Note: one does not package a Vignette with the R package distribution, rather Vignettes are dynamically built after downloading the package. Thus it makes no sense to add the html-rendered Vignette to your git repository: on your local machine you are simply rendering the output of your .Rmd file, and the package user does not need it. Normally the directories doc and inst/doc are therefore mentioned in the .Gitignore file and not committed to your repository. However, I am committing an updated version of the Vignette from revision to revision, to hold the html file on GitHub so that users of the rptPlus package can preview the result. To view .html files from a GitHub repository, use the preview function at https://htmlpreview.github.io/: the rptPlusVignette page thus can be accessed at http://htmlpreview.github.io/?https://github.com/hyginn/rptPlus/blob/master/doc/rptPlusVignette.html. You might add doc and inst/doc to your .Gitignore file for your own development purposes however to keep the size of your local repository reasonably small.

To remove Vignette support from your package

Suggests:
-    testthat,
+    testthat
-    BiocStyle,
-    knitr,
-    rmarkdown

2.6.6 Importing Bioconductor Packages

CRAN and Bioconductor are the two curated repositories from which we usually install trusted software. In the life-sciences world, we can't live without using both. However, while CRAN-hosted packages mentioned in the Imports: field of DESCRIPTION are automatically installed from CRAN, merely mentioning a Bioconductor package is not itself sufficient to install from Bioconductor. The trick to install them is surprising and simple: you merely need to add a biocViews: field to DESCRIPTION. Such a field with keywords that define how a package fits into the Bioconductor project is required for all Bioconductor packages. But here we simply use it for its side-effect of directing the package installer to search Bioconductor as well as CRAN for packages, it is just a placeholder.

To be able to import Bioconductor packages in addition to CRAN packages:

biocViews: Software, Infrastructure

To remove Bioconductor installation support:

LazyData: true
-   biocViews: Software, Infrastructure
Imports:
-       Biostrings,
    shiny,
    Rcpp
LinkingTo: Rcpp

2.6.7 A Secure Approach to Credentials

Any software that needs to connect to private assets such as databases or restricted-access Websites, sooner or later needs login credentials in code. These are typically strings like username/password combinations, or access tokens. You really don't want those credentials to appear in plaintext on GitHub, for everyone to see, forever. Here is how to keep your secrets secret.

The proper way to handle credentials from R scripts is to keep them in a separate file outside of your project directory: filenames ../.credentials or ~/.credentials are good choices. Load your secrets from a utility function at the moment they are needed. Your credentials file can be encrypted (see the further reading below), but it doesn't need to be, for general use cases.

For example: I could use a ~/.credentials file that is structured like this:

myAsset    dbadmin    quasitransconcillipurgination
myOtherAsset    testUser    ponytale

A function to get credentials could be published with my code:

getCredentials <- function(asset, getUser = FALSE, getPass = FALSE) {
  x <- readLines("~/.credentials")
  x <- x[grepl(asset, x)]
  x <- strsplit(x, "\\s+")[[1]][2:3]
  return(x[c(getUser, getPass)])
}

The function could be used in code like this:

mydb <-  RMySQL::dbConnect(RMySQL::MySQL(),
                           user =     getCredentials("myAsset", getUser = TRUE),
                           password = getCredentials("myAsset", getPass = TRUE),
                           dbname = "myDBAsset")

Some more things I would consider: - Don't rely on a .gitignore file to keep your secrets secret - it might inadvertently break. - Dont use .Renviron for your secrets and load them with Sys.getenv(), the file might accidentally get posted. - Don't keep your secrets in global options, you might inadvertently include them in a save()d .RData file.

For more in-depth discussion and alternatives: - Securely storing your secrets in R code (Andrie de Vries, 2015) - Managing secrets (Hadley Wickham, httr Vignette) - Securing Credentials (RStudio, Databases using R - Best Practices)

2.6.8 Compiled C++ code

Using C++ code in your package has been made easy with the Rcpp package. What you need to do is to run Rcpp::sourceCpp("<your-function-name>.cpp") to compile and link your code, and then call it with cpp_<your-function-name>(). However, distributing compiled C++ code with your package is a bit more involved, you need assets that are included here:

The source for a minimal sample function (./src/codonSplitCpp,cpp) is included and documented with the package framework, its use is demonstrated in the sample script ./inst/scripts/benchmarkCodons.R. Once everything is set up, the process of compiling and linking the code is handled automaticaly by the RStudio build tools. Thus the development process is:

Additional reading: Hadley Wickham's "R-packages" chapter on Compiled Code Hadley Wickham's "Advanced R" chapter on Rcpp The vignettes that are distributed with the Rcpp package: vignette("Rcpp-introduction") vignette("Rcpp-attributes") * vignette("Rcpp-package")

To use C++ code in your package:

Read Hadley Wickham's "R-packages" chapter on Compiled Code. Then rename the files that are distributed with rptPlus to reflect your package name. Build, document and install. Then validate by working through ./inst/scripts/benchmarkCodons.R. This brings you to a "known-good-state". After that, copy, edit and develop. Make sure to save frequently: bugs in your C++ code will crash your RStudio session.

To remove C++ code support from your package:

Imports:
    Biostrings,
-      shiny,
-      Rcpp
+      shiny

-   LinkingTo: Rcpp

Suggests: ...

2.6.9 A Shiny App

Shiny apps are great for two purposes: as a part of package documentation they can give your (potential) user a hands-on view into what your package can do. And if you are supporting users who don't code, you can make the workflow of your package available through a GUI.

In order to distribute a Shiny app with your package: * Add the shiny package as a dependency into the DESCRIPTION file. In rptPlus I have included shiny under the Imports: heading; in case you consider the functionality of your Shiny app to be optional, you can move it under the Suggests: heading.

To include a shiny app in your package:

Check, build, document, and install.

Validate run run<your-shiny-app-name>() in the console. This should open the app in the viewer.

This is your "known-good-state". Learn about shiny options, develop, and save and test frequently. Note that a good purpose of your app is as a quickstart into your package's functions. Make sure you are loading defaults when the app loads so it shows something interesting, and explain your parameters, proposing reasonable defaults.

To remove shiny support from your package:

Imports:
    Biostrings,
-    shiny,
    Rcpp

2.6.10 Considerations for Reproducible Research

The label "Reproducible Research" summarizes best practice that derives from the principles of the scientific method. Even though this means different things to different scientists (see below), a broad consensus includes

Building a package along the principles laid out in rptPlus supports these goals in multipe ways.

Documenting THAT your analysis works ...

This is the essential beginning: is your code correct, and is your analysis valid? Correct code can be supported by unit- and integration tests using the testing infrastructure mapped out in the package. Aim to cover all of your code with tests and test after every change. Keeping a tight link between writing tests and writing code goes a long way towards arriving at well structured, maintainable software; this principle has given rise to test-driven development methods. Showing that the analysis is valid requires a bit more than showing that your code is correct. Essentially you need to minimally show that your analysis can recover the correct parameters from a dataset. Since the correct parameters are virtually never known in real-world examples, you must provide synthetic data, constructed with known properties. The package structure of rptPlus gives you - ways to document such data as internal and exported datasets, - a place to store the scripts that generate your data and your model analysis (in ./inst/scripts), - and a way to communicate this part of the analysis, in a Vignette.

Documenting HOW your analysis works ...

This is often taken to include exact reproducibility, but the importance of this may be overstated. Obviously the packages you import need to be explicitly defined. The command sessionInfo() in the Vignette documents the loaded packages and versions. If your package critically depends on the exact version of packages, consider using packrat for a distributable, self-contained, everything-included project. But it is more important to make it easy to understand what exactly you are doing. Having all the files available (the reason we build this package in the first place), and being able to document what change was made by whom at what time (that's why we use git) is a prerequisite. But that does not really explain how everything fits together. For this, a hierarchical approach will help, that combines a high-level summary (perhaps a shiny app or workflow diagram), a mid-level detailed description (in a Vignette or other R markdown "literate program"), and at the finest-level, the actual code that produced the analysis (in a script included in ./inst/scripts). All of the code. Releasing your code snapshot in a known-good-state is a crucial part of the "how". E.g. you might release the project when a manuscript was submitted, or when revisions were accepted, as a GitHub release and/or deposit it on the excellent CERN-backed Zenodo platform.

Zenodo has the good side-effect of getting you a stable, citable doi for your package which makes it easy to include it in your professional CV. For detailed instructions how to connect your GitHub release to Zenodo, see here. In brief: - link your GitHub account to Zenodo simply by logging into this Zenodo page with your github account; - once the accounts are linked, you will see a list of repositories you can deposit to Zenodo. Switch your project to "ON"; - on your Github project page, click on releases and on Draft a new release; - enter your release information: this should be a "known-good-state", with an appropriate semantic version number (standard practice is v1.0.0 for your first release), make sure the same version number appears in your ./DESCRIPTION; - Click on Publish release. This will make an archived version of the repository available on Github, and it will automatically upload to Zenodo. - Back on Zenodo, refresh the list of repositories. Your linked repositories appear at the top of the list, and if a release has been deposited to Zenodo, a "doi badge" will appear with it. - Click on the badge to obtain the markdown code for the badge. Put it into your ./README.md. The badge will always link to the latest release, thus you don't need to update it. - Follow the link to your Zenodo record. It has a list of Versions in the sidebar. There is one doi which can link to all versions, and there is another doi for each specific version. You will probably want to put the "universal" doi into your ./inst/CITATION file for the package itself, since it always links to the latest version. Specific citations, e.g. to manuscripts, get the doi for the version at the time of publication. - Since you have made changes to ./README.md and possibly other files, you need to create a maintenance release. Update ./DESCRIPTION with a new version that simply increments the patch level (the last digit, eg. v1.0.1). Commit all your changes. Push to GitHub and create a new release, call it "Maintenance". You can describe that you have added doi information. Then Publish release.

Your Zenodo record will now contain two releases with specific dois, the latest release has the actual doi information that others can use, and your "doi badge" will link to the latest release. (Note: it might take a little while for the doi to get activated.) Everything is automatic from this point on.

Documenting WHY your analysis works ...

The "why" is the hardest part because it can't be expressed in schemata and templates. It is also the most important part of your documentation, the reason why your project exists in the first place. If your project is about analysis, you need to interpret the significance of what you found to your peers. If your project is about data, you need to outline the value of what can be discovered in the data to the potential analysts. If your project is about tools, you need to share your vision of what can be accomplished with it with your potential users. Data does not explain itself. Analyses are not self-evident. Tools don't make insight dispensible. Leaving a project at the state of the mere provision of resources is a wasted opportunity. But if you weave your vision throughout the structure of your package project, for yourself just as much as for your community, you contribute to the win-win proposition of reproducible, open science.

 

3 Develop

You are done with configuring your project. rptPlus should have been transformed into your own package project, and your edits should have left it in a "known-good-state" to work from.

Check your package frequently during development, and fix all errors right away. Package check errors have a way of interacting with each other that makes them hard to debug, it is best to address each one immediately when it occurs. Also, commit frequently and use meaningful commit messages. Your sanity will thank you. If you want to keep template files for reference, move them to the ./dev directory so they will not be included in the package build. Finally, whenever you add new contents, reference it in the LICENSE file. Whenever you remove one of the original files, remove it from the LICENSE file. And whenever you modify a function, add your name to any existing authors.

 

Some useful keyboard shortcuts for package authoring:

 

3.1 Update MD5

The home directory contains an MD5 file with the checksums of all packaged files. There is a script provided with the package to update this file. Open .dev\makeMD5.R and source() the script to load the function makeMD5(). Read what the function does. Then you should be able to simply type the following:

makeMD5()
tools::checkMD5sums("", getwd())

The first command will generate the ./MD5 file that will be included with your package. The second command will return TRUE or tell you what went wrong. Everyone who downloads your package can then simply check the integrity of the files against your version before executing the code. However: there is one limitation. tools::checkMD5sums() will only check the files that are listed in ./MD5. It will let you know if files are missing that are mentioned in ./MD5. But it will not complain if additional files have been added to your package.

 

4 What's in the box ...

Here is a list of assets provided with rptPlus and why they are included. You can delete everything you don't need, but note: you can't push empty directories to your repository. Make sure you keep at least one file in every directory that you want to keep during development.

.gitignore                     <- defines files that should not be committed to the repository
.Rbuildignore                  <- defines files that should not be included in the package
.Rprofile                      <- optional: runs code during startup
data/rptGC.RData               <- optional: sample exported data set
DESCRIPTION                    <- the metadata file for your package
dev                            <- optional: see (Note 1)
dev/checkEnds.R                <- optional: see (Note 1)
dev/functionTemplate.R         <- optional: see (Note 1)
dev/makeMD5.R                  <- optional: see (Note 1)
dev/rptTwee.R                  <- optional: see (Note 1)
doc/                           <- compiled vignettes: autogenerated, don't edit
inst/                          <- optional: see (Note 2)
inst/CITATION                  <- optional: citation information for the package
inst/extdata/                  <- optional: see (Note 3)
inst/extdata/test-lseq.dat     <- optional: see (Note 3)
inst/scripts/                  <- optional: see (Note 4)
inst/scripts/benchmarkCodons.R <- optional: see (Note 4)
inst/scripts/scriptTemplate.R  <- optional: see (Note 4)
inst/shiny-scripts/rptApp/app.R <- optional: a shiny app
LICENSE                        <- License(s)
man/                           <- help files, generated by Roxygen2: don't edit
Meta/                          <- the Vignette database. Autogenerated, don't edit
NAMESPACE                      <- lists exported functions and data. Generated by Roxygen2: don't edit
NEWS                           <- optional: package release progress
R/                             <- Contains the code for exported functions
R/lseq.R                       <- a sample function
R/makeSeq.R                    <- a function used in the benchmarking sample script
R/RcppExports.R                <- autogenerated for compiled C++ code
R/rptGC.R                      <- documentation header sample for an exported data set
R/rptPlus.R                    <- documentation header to include compiled code directives in NAMESPACE
R/runRptApp.R                  <- function to run the sample shiny app
R/zzz.R                        <- three functions for package management
README.md                      <- see (Note 5)
rptPlus.Rproj                  <- project options. Rename to <your-package-name>.Rproj
src/                           <- optional: folder for C++ code
src/codonSplitCpp.cpp          <- a sample C++ program
src/RcppExports.cpp            <- autogenerated to link compiled code. Do not edit.
tests                          <- see (Note 6)
tests/testthat                 <- contains scripts for tests to be run
tests/testthat/helper-functions.R <- a helper function that infers the package name
tests/testthat/test_lseq.R     <- a test script for ./R/lseq.R
tests/testthat.R               <- the script that runs the tests
vignettes/rptPlusVignette.Rmd  <- the sample Vignette included with rptPlus

 

5 FAQ

TBC

...

 

6 Notes

1 A good way to begin your development journey is to build a minimal package based on rpt, and then extend the package with assets you find in rptPlus in the context of an actual project .

2 Empty repositories by convention have a .git extension to the repository name, repositories with contents have no extension: the name indicates the repository directory and that directory contains the .git file. Therefore your package should NOT be named <package>.git although links to your repository on GitHub seem to be correctly processed with both versions. For more discussion, see here

3 Among the R development "dogmas" that have been proven again and again by experience are: "Don't work in the console, always work in a script." and "Never restore old Workspace. Recreate your Workspace from a script instead." Therefore my projects don't save history, and don't save (or restore) Workspace either. You don't have to follow this advice, but trust me: it's better practice.

4 A commonly agreed on coding style is to use 80 character lines or shorter. That's often a bit of a challenge when you use spaces around operators, expressive variable names, and 4-space indents. Of those three, the 4-space indents are the most dispensable; using 2-space indents works great and helps keep lines short enough. There seems to be a recent trend towards 2-spaces anyway. As for tabs vs. spaces: I write a lot of code that is meant to be read and studied, thus I need more control over what my users see. Therefore I use spaces, not tabs. YMMV, change your Project Options if you feel differently about this.

5 Displaying the startup message (as of this writing) works only once per session due to a long-standing bug in RStudio. (cf. here). To display the message, choose FileRecent Projects...<your-package-name> to reload your project, then type library(<your-package-name>) into the cosole.

6 Caution: the parameters for install() and install_github are surprisingly different. See here.

 

7 Further reading

R packages

Development

Reproducible Research

 

8 Acknowledgements

Thanks to my students, especially the BCB410 (Applied Bioinformatics) class of 2018, whose hard work on R packages revealed the need for this template. Yi Chen's careful proofreading helped make many points more specific.

 

 



hyginn/rptPlus documentation built on May 30, 2019, 2:11 p.m.