pytorch torch.nn.TransformerEncoder

APICLASS torch.nn.TransformerEncoder(encoder_layer, num_layers, norm=None)TransformerEncoder is a stack of N encoder layers参数描述encoder_layeran instance of the TransformerEncoderLayer() class (required

Claroja

8392人浏览 · 2020-09-04 20:26:31

Claroja · 2020-09-04 20:26:31 发布

API

CLASS torch.nn.TransformerEncoder(encoder_layer, num_layers, norm=None)

TransformerEncoder is a stack of N encoder layers

参数	描述
encoder_layer	an instance of the TransformerEncoderLayer() class (required).
num_layers	the number of sub-encoder-layers in the encoder (required).
norm	the layer normalization component (optional).

encoder_layer = nn.TransformerEncoderLayer(d_model=512, nhead=8)
transformer_encoder = nn.TransformerEncoder(encoder_layer, num_layers=6)
src = torch.rand(10, 32, 512)
out = transformer_encoder(src)