layer_self_attention_simple: Simplified Self attention layer Expecting shape(x) == (batch,...
In ifrit98/transformR: An R Implementation of Transformer Model with Self Attention
View source: R/attention-layers.R
Description
Simplified Self attention layer
Expecting shape(x) == (batch, maxtime, units)
Usage
1
2
3
4
5
6
7
8
layer_self_attention_simple(
x,
filter_depth = 32L,
output_depth = 64L,
num_parts = 3L,
dropout = 0,
share_kv = TRUE
)
ifrit98/transformR documentation built on Nov. 26, 2019, 2:14 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
View source: R/attention-layers.R
Description
Simplified Self attention layer Expecting shape(x) == (batch, maxtime, units)
Usage
1 2 3 4 5 6 7 8 | layer_self_attention_simple(
x,
filter_depth = 32L,
output_depth = 64L,
num_parts = 3L,
dropout = 0,
share_kv = TRUE
)
|
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.