Intended as a tool for familiarization with a dataset,
identification of outliers, and further analyses.
This may also be helpful in describing data to the visually impaired.
NOTE: This package requires the installation of a separate standalone synthesizer application. The R functions will send plots to this program, which is where you will "play" your plots. See Details for details.
The standalone application uses QuickTime, without which visual details will not appear.
audiolyzR translates scatterplots, scatterplot matrices, histograms, and (soon) other plots into corresponding audio graphics. You will see that the plots are played either by looping from left to right, or by directing an interactive cursor.
You will have live control over global volume and tempo, along with quality (major vs minor vs augmented, etc.), range of pitches (in case you have trouble hearing particularly high or low notes), and gap between loops.
Things to note and pay attention to while you listen:
1) The X or horizontal axis corresponds to time (not pitch).
2) Pitch corresponds to the Y or vertical axis.
3) Reverb is inversely proportional to correlation (more reverb for less correlation).
4) Synthesizer dryness is mildly related to number of points in a column.
5) Relative note volume is inversely proportional to the number of notes in a neighborhood of each (higher volume for fewer neighbors)
Instructions for the external audiolyzR application:
In order to run audiolyzR, you need to install the appropriate standalone application. The first time you run any audiolyzR command, it will automatically install the appropriate version for your system. If you prefer to download the files yourself:
Also, make sure you are running a functioning version of Apple QuickTime, or you won't see the visual representation of the data in the synthesizer.
Eric Stone, Jesse Garrison,
Contributions from Nate Wheeler
Baier T, Neuwirth E, Meo MD (2011). "Creating and Deploying an Application with RExcel and R." R Journal, 3/2.
Brown E (2012). playitbyr: Representing and exploring data through sound. R Package: Version 0.2-1, http://playitbyr.org/.
Carr D, Maechler M, Lewin-Koh N (2012). hexbin: Hexagonal Binning Routines. R Package: Version 1.26-0, http://cran.r-project.org/web/packages/hexbin/index.html.
CDC (2012). "National Health and Nutrition Examination Survey." www.cdc.gov/nchs/nhanes.htm.
Chambers JM (1983). Graphical methods for data analysis. Wadsworth & Brooks/Cole, Pacific Grove, CA.
Chambers JM, Mathews MV, Moore FR (1974). "Auditory Data Inspection." Technical Memorandum, 74-1214-20.
Cycling74 (2012). Max/MSP. http://cycling74.com/docs/max6/dynamic/c74_docs.
Flowers J (2005). "THIRTEEN YEARS OF REFLECTION ON AUDITORY GRAPHING : PROMISES , PITFALLS , AND POTENTIAL NEW DIRECTIONS." Faculty Publications, Univ of Nebraska, pp. 406 to 409. http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1429&context=psychfacpub.
Froehlich I (2011). "Tonematrix." http://tonematrix.audiotool.com.
Frysinger SP (2005). "A Brief History of Auditory Data Representation to the 1980s." First Symposium on Auditory Graphs, pp. 1980 to 1983.
Hermann T, Hunt A, Neuhoff JG, Walker BN, Nees MA (2011). The Sonification Handbook, Chapter 2: Theory of Sonification. ISBN 9783832528195.
Hunt A, Hermann T, Pauletto S (2004). "Interacting with sonification systems: closing the loop." Proceedings. Eighth International Conference on Information Visualisation, IV, 879 to 884. http://ieeexplore.ieee.org/lpdocs/ epic03/wrapper.htm?arnumber=1320244.
Merabet LB, Pascual-Leone A (2010). "Neural reorganization following sensory loss: the opportunity of change." Nature reviews. Neuroscience, 11(1), 44 to 52. ISSN 1471-0048. doi:10.1038/nrn2758. http://www.ncbi.nlm.nih.gov/pubmed/19935836.
Neuwirth E (2012). RExcelInstaller: Integration of R and Excel, (use R in Excel, read/write XLS files). R Package: Version 3.2.3-1, http://cran.r-project.org/web/packages/RExcelInstaller/index.html.
R Core Team (2012). R: A Language and Environment for Statistical Computing. R Foun- dation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, http://www.R-project.org.
Sarkar D (2008). Lattice: Multivariate Data Visualization with R. Springer Science+Business Media.
Sarkar D (2012). lattice: Lattice Graphics. R Package: Version 0.20-10, http://cran. r-project.org/web/packages/lattice/index.html.
Stein BE, Stanford TR (2008). "Multisensory integration: current issues from the perspective of the single neuron." Nature reviews. Neuroscience, 9(4), 255 to 66. ISSN 1471-0048. doi: 10.1038/nrn2331. http://www.ncbi.nlm.nih.gov/pubmed/18354398.
Stone E, Garisson J (2012). "Give Your Data a Listen." In UserR! Conference Proceedings. http://biostat.mc.vanderbilt.edu/wiki/pub/Main/UseR-2012/81-Stone.pdf.
Journal of Statistical Software 15 Tukey JW (1977). "Exploratory Data Analysis." Addison-Wesley.
Vercoe B (2012). The Canonical Csound Reference Manual. MIT Media Lab. Version 5.17.1.
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.