| multi_head {transformer} | R Documentation |
Multi-Headed Attention
Description
Multi-Headed Attention
Usage
multi_head(Q, K, V, d_model, num_heads, mask = NULL)
Arguments
Q |
queries |
K |
keys |
V |
values |
d_model |
dimensions of the model |
num_heads |
number of heads |
mask |
optional mask |
Value
multi-headed attention outputs
[Package transformer version 0.2.0 Index]