dl::TransformerConf Struct Reference

Public Attributes
struct {
size_t   model
size_t   key
size_t   value
size_t   inner
}	dimensions
size_t	numEncoders
size_t	numAttnHeads

Detailed Description

Definition at line 25 of file transformer.hpp.

Member Data Documentation

inner

size_t dl::TransformerConf::inner

\(d_\text{ff}}}\) from [8] .

Definition at line 30 of file transformer.hpp.

key

size_t dl::TransformerConf::key

\(d_k}}\) from [8] .

Definition at line 28 of file transformer.hpp.

model

size_t dl::TransformerConf::model

\(d_\text{model}}}\) from [8] .

Definition at line 27 of file transformer.hpp.

numAttnHeads

size_t dl::TransformerConf::numAttnHeads

Definition at line 33 of file transformer.hpp.

numEncoders

size_t dl::TransformerConf::numEncoders

Definition at line 32 of file transformer.hpp.

value

size_t dl::TransformerConf::value

\(d_v}}\) from [8] .

Definition at line 29 of file transformer.hpp.

---

The documentation for this struct was generated from the following file:

• dl/model/transformer/transformer.hpp