View source: R/attention-utils.R
query [batch, length_q, channels] memory [batch, length_m, channels] (optional, usually RNN hidden states) return [batch, length, depth] (q, k ,v) tensors
1 2 3 4 5 6 7 8 9 10 11 | compute_qkv(
query,
memory = NULL,
key_depth = 64L,
value_depth = 64L,
q_filter_width = 1L,
kv_filter_width = 1L,
q_padding = "valid",
kv_padding = "valid",
vars_3d_num_heads = 0L
)
|
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.