SoftMax: SoftMax sigmoid function

In attention: Self-Attention Algorithm

SoftMax sigmoid function

Description

SoftMax sigmoid function

Usage

SoftMax(x)

Arguments

x	input value (numeric)

Value

output value (numeric)

Examples

# create a vector of integers (also works for non-integers)
set.seed(0)
V = c(floor(runif(9, min=-3, max=3)))
print(V)

# this outputs
# [1]  2 -2 -1  0  2 -2  2  2  0

# apply the SoftMax() function to V
sV <- SoftMax(V)
print(sV)

# this outputs
# [1] 0.229511038 0.004203641 0.011426682 0.031060941
# 0.229511038 0.004203641 0.229511038 0.229511038 0.031060941

attention documentation built on Nov. 10, 2023, 9:09 a.m.