AttentionAugmentationLayer2D: Attention augmentation layer (2-D)

AttentionAugmentationLayer2DR Documentation

Attention augmentation layer (2-D)

Description

Attention augmentation layer (2-D)

Value

output of tensor shape batchSize, height, width, depthOfQueries.

Arguments

depthOfQueries

number of filters for queries.

depthOfValues

number of filters for values.

numberOfHeads

number of attention heads to use. It is required that depthOfQueries/numberOfHeads > 0.

isRelative

whether or not to use relative encodings.

Details

$initialize instantiates a new class.

$call main body.

$compute_output_shape computes the output shape.

Author(s)

Tustison NJ


ANTsX/ANTsRNet documentation built on Nov. 21, 2024, 4:07 a.m.