NEWS.md

In mitre/sparklyr.nested: A 'sparklyr' Extension for Nested Data

sparklyr.nested 0.0.4

• Replaced now-defunct dplyr::select_vars calls with tidyselect::vars_select
• Support (optionally) using listviewer::reactjson to view schemas

sparklyr.nested 0.0.3

• Initial release
• To support read schemas, array_type, binary_type, boolean_type, byte_type, character_type, date_type, double_type, float_type, integer_type, long_type, map_type, numeric_type, string_type, struct_field, struct_type, and timestamp_type are provided. These will return java references needed for schema definition.
• sdf_select enables access to nested fields (within maps, structs, and arrays of structs).
• sdf_explode will convert arrays of structs to simple structs by duplicating rows over each unique array entry. Also works on map types if is_map=TRUE.
• sdf_nest and sdf_unnest are similar to the similarly named tidyr functions. sdf_unnest essentially chains sdf_explode and sdf_select with some schema inspection.
• sdf_schema_json and sdf_schema_viewer support schema interrogation

mitre/sparklyr.nested documentation built on Feb. 22, 2023, 10:09 a.m.