dataset_shard: Creates a dataset that includes only 1 / num_shards of this...
In tfdatasets: Interface to 'TensorFlow' Datasets
View source: R/dataset_methods.R
dataset_shard R Documentation
Creates a dataset that includes only 1 / num_shards of this dataset.
Description
This dataset operator is very useful when running distributed training, as it
allows each worker to read a unique subset.
Usage
dataset_shard(dataset, num_shards, index)
Arguments
dataset
A dataset
num_shards
A integer representing the number of shards operating in
parallel.
index
A integer, representing the worker index.
Value
A dataset
tfdatasets documentation built on Sept. 11, 2024, 8:53 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
View source: R/dataset_methods.R
| dataset_shard | R Documentation |
Creates a dataset that includes only 1 / num_shards of this dataset.
Description
This dataset operator is very useful when running distributed training, as it allows each worker to read a unique subset.
Usage
dataset_shard(dataset, num_shards, index)
Arguments
dataset |
A dataset |
num_shards |
A integer representing the number of shards operating in parallel. |
index |
A integer, representing the worker index. |
Value
A dataset
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.