Transformer Block Stack

From GM-RKB
(Redirected from Stacked Transformer block)
Jump to navigation Jump to search

A Transformer Block Stack is a stack of transformer blocks.



References

2019

  • https://jalammar.github.io/illustrated-transformer/
    • QUOTE: ... The encoding component is a stack of encoders (the paper stacks six of them on top of each other – there’s nothing magical about the number six, one can definitely experiment with other arrangements). The decoding component is a stack of decoders of the same number. ...

    • ... This goes for the sub-layers of the decoder as well. If we’re to think of a Transformer of 2 stacked encoders and decoders, it would look something like this: