knitr::opts_chunk$set( collapse = TRUE, comment = "#>" )
library(glyph)
This guide adds a new mark type to glyph, from the R function to the
drawing code in the browser. The example is a lollipop mark: a stem from
zero to each value, with a dot at the end. glyph doesn't have one yet, so
you can follow along and end up with a working mark_lollipop().
knitr::include_graphics("custom-marks-lollipop.png")
Be clear about one thing before you start. Adding a mark means editing glyph's own source code. There is no way yet to add a mark from another package or from a script. The last section explains why, and what would have to change.
You need a copy of the glyph source, and R with devtools. To try the browser tests at the end, you also need chromote and Chrome.
A mark passes through five places on its way to the screen:
mark_point() adds a mark to the spec. The spec is
a plain R list.compile() resolves the mark's mappings against the data and turns the
spec into JSON.inflateSpec() in inst/htmlwidgets/glyph.js turns the data back into
one object per row.drawMark() in the same file calls the drawing function for the mark's
type.Steps 2 to 4 are the same for every mark. A new mark needs code in steps 1 and 5, plus a few hooks for axes and interactions.
Every mark function is a thin wrapper around add_mark() in R/marks.R.
Add mark_lollipop() to that file, next to the other marks:
#' Add a lollipop mark #' #' Draws a stem from zero to each value, with a dot at the end. #' @inheritParams mark_point #' @return Modified \code{glyph_spec} object with the lollipop mark added #' @export #' #' @examples #' df <- data.frame(fruit = c("apple", "fig", "kiwi"), sold = c(12, 7, 9)) #' glyph(df, x = fruit, y = sold) |> mark_lollipop() mark_lollipop <- function(spec, ..., data = NULL, style = list()) { add_mark(spec, "lollipop", rlang::enquos(...), data, style, defaults = list(size = 5, stroke_width = 1.5, opacity = 0.9)) }
add_mark() takes:
type: the name the browser uses to pick the drawing function. Here it
is "lollipop".quos: the mappings passed in ..., such as color = shop. They are
captured, not evaluated, so they can refer to columns.data: an optional data frame just for this mark.style: fixed visual properties set by the user. They are merged over
defaults, so style = list(size = 8) overrides the default dot size.stat: for marks that summarise data. See "Marks that summarise data"
below.Run devtools::document() to add the help page and the export to
NAMESPACE. Then add mark_lollipop to the "Marks" section of
_pkgdown.yml so the reference page lists it.
The mark is now stored in the spec like any other. You can see the same structure for an existing mark:
sales <- data.frame( fruit = c("apple", "fig", "kiwi", "pear"), sold = c(12, 7, 9, -3) ) p <- glyph(sales, x = fruit, y = sold * 2) |> mark_point() str(p$marks[[1]][c("type", "style", "id", "stat")])
Each mark gets an id from its type and position, such as point_1. The
id is used to name computed columns, as the next step shows.
compile() handles mappings the same way for every mark, so a new mark
gets this for free. In resolve_mark() in R/render.R:
x = fruit, is kept as a field name.y = sold * 2, is evaluated against the data
and stored in a new column called .g_<id>_<aesthetic>. The expression
text becomes the axis label."quantitative", "nominal" or "temporal".
The browser uses it to pick a scale.x, y, x2, y2,
y_min or y_max) are dropped, with a warning.The result is the mark's encoding:
compiled <- compile(p) str(compiled$spec$marks[[1]]$encoding)
Your drawing code reads values through these fields. It never needs to know whether a mapping was a plain column or an expression.
Plot data is sent as columns, not rows. This makes compile() fast on
large data. The plot's own data looks like this:
str(compiled$spec$data)
A mark that draws the plot's data doesn't carry a copy. It names the columns it uses and, if any rows were dropped for missing values, which rows it keeps:
str(compiled$spec$marks[[1]]$data)
A mark with its own data sends its own columns instead. A statistical
mark sends its summaries as values, one record per box or bin.
You don't have to deal with any of this. Before anything is drawn,
inflateSpec() in glyph.js turns every mark's data back into an array of
row objects. So your drawing function gets data as rows like
{fruit: "apple", sold: 12, ".g_point_1_y": 24}, with exactly the rows it
should draw.
The browser side lives in inst/htmlwidgets/glyph.js. First add a case to
the switch in drawMark():
case "lollipop": drawLollipop(g, data, enc, scales, style, w, h, interact, theme, markRegistry); break;
Then add the drawing function. A good place is next to drawBars():
// A stem from zero to each value, with a dot at the end. Each lollipop is // one <g>, so tooltips, hover, brushing and selection all act on the stem // and the dot together. function drawLollipop(g, data, enc, scales, style, w, h, interact, theme, markRegistry) { const baseOpacity = style.opacity ?? 0.9; const r = style.size || 5; const slotWidth = groupSlotWidth(scales, enc, 40); const px = d => xPos(scales, enc, d, slotWidth); const py = d => yPos(scales, enc, d); // Stems start at zero, or at the edge of the plot when a domain set with // set_scale() leaves zero outside it. const base = scales.y ? Math.max(0, Math.min(h, scales.y(0))) : h; const colour = d => scales.color ? scales.color(getVal(d, enc.color)) : (theme.accent || "#4269d0"); const pops = g.append("g").attr("class", "marks-lollipop") .selectAll("g") .data(data) .join("g") .attr("class", "glyph-lollipop") .attr("opacity", baseOpacity); pops.append("line") .attr("x1", px).attr("x2", px) .attr("y1", base).attr("y2", py) .attr("stroke", colour) .attr("stroke-width", style.stroke_width || 1.5); pops.append("circle") .attr("cx", px).attr("cy", py) .attr("r", r) .attr("fill", colour); // Brushing selects a lollipop when its dot is inside the brushed area. const finder = pointFinder(pops, px, py); registerMark(markRegistry, pops, baseOpacity, { brush: { rowLevel: true, nearest: (mx, my, tolerance) => finder.nearest(mx, my, tolerance), hit: (d, i, node, [[x0, y0], [x1, y1]]) => { const x = px(d), y = py(d); return x >= x0 && x <= x1 && y >= y0 && y <= y1; }, opacity: hit => hit ? 1 : 0.15 } }); if (interact.tooltip?.enabled) addTooltip(pops, data, enc, interact.tooltip, theme); if (interact.hover?.enabled) { pops .on("mouseover.hover", function() { d3.select(this).select("circle").attr("r", r * 1.6); }) .on("mouseout.hover", function() { d3.select(this).select("circle").attr("r", r); }); } if (interact.click?.enabled) addClickSelect(pops, interact.click.action, baseOpacity, markRegistry); }
The arguments are the same for every drawing function:
g is the plot area, an SVG group. Draw inside it. Its origin is the
top-left corner of the plotting area, inside the axes.data is the array of rows from step 3.enc is the encoding from step 2. Read a value with
getVal(d, enc.y), not d.y, because the field name may be generated.scales holds the plot's scales: scales.x, scales.y, and
scales.color or scales.size when those are mapped. They are shared
with every other mark on the plot.style is the merged style list from the R function.w and h are the width and height of the plotting area in pixels.interact is what the user set with interact().theme holds the theme tokens, such as theme.accent and theme.fg.markRegistry is where the mark registers itself for brushing and
selections (step 6).xPos() places a value on the x scale. On a categorical scale it puts it
in the middle of its band, which is what most marks want. yPos() does the
same for y.
Wrap each element in a class of its own, such as marks-lollipop and
glyph-lollipop. That gives tests and stylesheets something to find.
The x and y scales cover every mark's values. markExtent() in glyph.js
reports the range each mark draws along an axis. For plain mappings it
uses the mapped column, which is enough for most marks.
A lollipop measures from zero, like a bar, so its value axis should include
zero. Add "lollipop" to the rule that does this for bars and areas:
if (axis === "y" && (mark.type === "bar" || mark.type === "area" || mark.type === "lollipop")) vals.push(0);
If your mark draws something other than its mapped values, such as a
whisker or a bin edge, add a branch to markExtent() that pushes those
values instead. The statistical marks do this. Without it, part of the mark
can be drawn outside the axes.
Interactions are where most of the work in a new mark goes. glyph has helpers for each of them.
Tooltips. addTooltip(selection, data, enc, interact.tooltip, theme) shows
the mapped fields when the pointer is over an element, and on tap on touch
screens. It uses the widget's one shared tooltip. Don't create your own
tooltip elements: each redraw would leave another one behind.
Hover. The built-in addHoverEffect() changes the radius or outline of the
element itself. A lollipop is a group, so the example writes its own small
handler that enlarges the dot inside the group.
Brushing. When brushing is on, an overlay covers the plot so a drag can
start anywhere. The overlay also takes the pointer events the marks would
get. glyph forwards them to the element under the pointer, but only for
marks registered with registerMark(). The brush part of the
registration says:
rowLevel: true when each element draws one row, as here. Statistical
marks set it to false.nearest: the element at a point. pointFinder() does this quickly for
marks that sit at a single point.hit: whether the brushed rectangle selects an element.opacity: the opacity of selected and unselected elements while a
selection exists.Forwarded events are sent to the element that nearest returns. Attach
every listener (tooltip, hover, click) to that same element. A listener on
a child, such as the circle inside a lollipop's group, would never see
them.
Registering the mark also connects it to linked selections in compose(),
to legend selections, to the "Clear selection" button and to the Escape
key. These all change the opacity of the registered elements, so put the
opacity on the group, not on its children.
Click. addClickSelect() handles interact(click = ...) and selection
from linked panels.
Plots are drawn at the size of the container they are in, and redrawn when it changes size (#17). Fitting a plot can take up to three draws, and every resize redraws the whole plot. Your drawing function will run many times. Three rules keep it working:
w, h and the scales. Never read the spec's
width or height. They are only a fallback for a container that has no
size yet.document or window directly. If you need one,
use onDocumentTap(), which removes listeners left by earlier draws.Facets, compose() and inset() call the same drawing function once per
panel, each with its own g, w, h and scales. A mark that follows
these rules works in all of them without extra code. Zoom also works
without extra code, because it transforms the whole plot area.
Add tests in tests/testthat/test-lollipop.R. An R test checks what
compile() produces:
sales <- data.frame(fruit = c("apple", "fig", "kiwi", "pear"), sold = c(12, 7, 9, -3)) test_that("mark_lollipop() adds a lollipop layer", { spec <- glyph(sales, x = fruit, y = sold) |> mark_lollipop() mark <- spec$marks[[1]] expect_equal(mark$type, "lollipop") expect_equal(mark$style$size, 5) compiled <- compile(spec)$spec$marks[[1]] expect_equal(compiled$encoding$y$field, "sold") expect_equal(compiled$encoding$x$type, "nominal") })
A browser test checks what was drawn. The helpers in
tests/testthat/helper-browser.R open the plot in headless Chrome through
chromote. axisMap() converts drawn positions back to data values through
the axis ticks, so the test compares the drawing with the data, not with
glyph's own calculations:
test_that("lollipops are drawn from zero to their value", { skip_if_no_browser() s <- open_page(save_page( glyph(sales, x = fruit, y = sold) |> mark_lollipop() |> interact(tooltip = TRUE, brush = TRUE) )) js(s, AXIS_JS) drawn <- js(s, "(() => { const y = axisMap('y'); return [...document.querySelectorAll('.glyph-lollipop')].map(p => ({ base: y(+p.querySelector('line').getAttribute('y1')), tip: y(+p.querySelector('line').getAttribute('y2')), dot: y(+p.querySelector('circle').getAttribute('cy')) })); })()") expect_length(drawn, 4) expect_equal(vapply(drawn, `[[`, numeric(1), "base"), rep(0, 4), tolerance = 0.05) expect_equal(vapply(drawn, `[[`, numeric(1), "tip"), sales$sold, tolerance = 0.05) expect_equal(vapply(drawn, `[[`, numeric(1), "dot"), sales$sold, tolerance = 0.05) expect_length(page_errors(s), 0) })
Browser tests skip on CRAN and wherever chromote or Chrome is missing. The browser-tests and R CMD check workflows run them on every pull request.
Then try the mark by hand:
devtools::load_all() glyph(sales, x = fruit, y = sold) |> mark_lollipop(color = sold > 0) |> interact(tooltip = TRUE, hover = "enlarge", brush = TRUE, zoom = TRUE)
Hover a dot, brush a few lollipops, clear the selection, zoom and reset,
and resize the window. Add facet() and try it again.
Some marks draw a summary of the data rather than one element per row, as boxplots and histograms do. glyph computes those summaries in R when the plot is compiled (#6), so the browser only draws what it is sent. To add one:
stat to add_mark(), for example
stat = list(type = "errorbar", level = 0.95). Settings for the
statistic go in the same list.stat_errorbar() function in R/stats.R and add it to the
switch in compute_stat(). It gets the mark's rows after mappings are
resolved and missing values dropped. It returns one record per summary
element, with the encoding it should be drawn with..rows field: the 0-based indices of the rows it
summarises. Brushing and linked selections use it to connect a summary
to the rows behind it.x and color, so each facet panel
gets its own summaries. The helpers in R/stats.R do this.glyph.js, add a markExtent() branch for the values the summary
draws, and a drawing function as in step 4. Register the elements with
addStatInteractions(), which sets up tooltips, hover, click and a
brush that selects by bounding box.mark_polygon() uses the same route without computing a statistic. It
collects its vertex rows into one record per shape, and gives the brush its
own hit test for the shape. Read stat_polygon() and drawPolygon() for
a complete, short example.
Adding a mark means editing four places in glyph itself: R/marks.R,
drawMark() and a drawing function in glyph.js, markExtent() when the
axes need it, and R/stats.R for a summarising mark. You can't do it from
another package or from your own script:
add_mark() is internal. You could reach it with glyph:::add_mark(),
and compile() would accept the result. But the browser would draw
nothing for an unknown type, and give no error.drawMark() chooses the drawing function with a fixed switch. There is
no way to register a new type with it.Extending glyph from outside would need at least:
add_mark();glyph.registerMark("lollipop", { draw, extent }), which drawMark()
and markExtent() check before their built-in cases;render() includes;registerMark(), addTooltip(), pointFinder() and the rest.None of these exist yet.
Some of what this guide relies on is more settled than the rest. Likely to stay:
type, mappings, data, style,
id and stat;Likely to change:
$schema version;glyph.js and the shape of the brush registration;A few features don't know about new marks:
animate(). Its entrance transitions select elements by tag, such as
rects for "slide" and circles, rects and paths for "fade". A
lollipop's dots would fade in but its stems wouldn't. Add your mark's
elements to applyAnimation() if you want it animated.to_vegalite(). It copies the mark type into the Vega-Lite spec, and
Vega-Lite has no "lollipop" mark.R/marks.R: the mark_*() function, documented and exported._pkgdown.yml: the new reference page.inst/htmlwidgets/glyph.js: a case in drawMark(), the drawing
function, and markExtent() if the axes need it.R/stats.R: a stat_*() function and a case in compute_stat(), for a
mark that summarises data.tests/testthat/: an R test and a browser test.NEWS.md: an entry for the new mark.Any scripts or data that you put into this service are public.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.