feed_forward {transformer}

Feed Forward Layer

Description

Feed Forward Layer

Usage

feed_forward(x, dff, d_model)

Arguments

x

inputs

dff

dimensions of feed-forward model

d_model

dimensions of the model

Value

output of the feed-forward layer